2026-09-30 17:12:23,301 [ 217147 ] INFO : ClickHouse root is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse (runner:42, check_args_and_update_paths)
2026-09-30 17:12:23,302 [ 217147 ] INFO : Cases dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:86, check_args_and_update_paths)
2026-09-30 17:12:23,302 [ 217147 ] INFO : utils dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/utils (runner:97, check_args_and_update_paths)
2026-09-30 17:12:23,302 [ 217147 ] INFO : base_configs_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/programs/server, binary: /home/ubuntu/_work/_temp/test/build/clickhouse, cases_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration  (runner:99, check_args_and_update_paths)
clickhouse_integration_tests_volume
Running pytest container as: 'docker run   --rm --name clickhouse_integration_tests_v2s3tl --privileged --dns-search='.' --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=2cffe1eae894 -e DOCKER_BASE_TAG=b74d853ebe76 -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=caad4729259e   -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600  -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10  -rfEps --run-id=0 --color=no --durations=0 'test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node0-True]' 'test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node1-False]' test_failed_mutations/test.py::test_exponential_backoff_with_replicated_tree 'test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[False]' 'test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[True]' test_fetch_partition_with_outdated_parts/test.py::test_fetch_partition_with_outdated_parts test_file_schema_inference_cache/test.py::test 'test_filesystem_cache/test.py::test_caches_with_the_same_configuration[node]' 'test_filesystem_cache/test.py::test_caches_with_the_same_configuration_2[node_caches_with_same_path]' test_filesystem_cache/test.py::test_custom_cached_disk test_filesystem_cache/test.py::test_force_filesystem_cache_on_merges test_filesystem_cache/test.py::test_keep_up_size_ratio 'test_filesystem_cache/test.py::test_parallel_cache_loading_on_startup[node]' test_filesystem_cache/test.py::test_system_sync_filesystem_cache test_grant_and_revoke/test_without_table_engine_grant.py::test_table_engine_and_source_grant test_http_native/test.py::test_http_native_returns_timezone test_intersecting_parts/test.py::test_intersect_parts_when_restart test_jbod_balancer/test.py::test_jbod_balanced_merge test_jbod_balancer/test.py::test_replicated_balanced_merge_fetch test_join_set_family_s3/test.py::test_join_s3 test_join_set_family_s3/test.py::test_set_s3 test_kafka_bad_messages/test.py::test_bad_messages_parsing_exception test_kafka_bad_messages/test.py::test_bad_messages_parsing_stream test_kafka_bad_messages/test.py::test_bad_messages_to_mv test_keeper_back_to_back/test.py::test_concurrent_watches test_keeper_back_to_back/test.py::test_end_of_session test_keeper_back_to_back/test.py::test_end_of_watches_session test_keeper_back_to_back/test.py::test_multitransactions test_keeper_back_to_back/test.py::test_random_requests test_keeper_back_to_back/test.py::test_sequential_nodes test_keeper_back_to_back/test.py::test_simple_commands test_keeper_back_to_back/test.py::test_stats test_keeper_back_to_back/test.py::test_watchers test_keeper_client/test.py::test_base_commands test_keeper_client/test.py::test_big_family test_keeper_client/test.py::test_delete_stale_backups test_keeper_client/test.py::test_find_super_nodes test_keeper_client/test.py::test_four_letter_word_commands test_keeper_client/test.py::test_get_all_children_number test_keeper_client/test.py::test_quoted_argument_parsing test_keeper_client/test.py::test_rm_with_version test_keeper_client/test.py::test_rm_without_version test_keeper_client/test.py::test_set_with_version test_keeper_client/test.py::test_set_without_version test_keeper_force_recovery_single_node/test.py::test_cluster_recovery test_keeper_four_word_command/test.py::test_cmd_clrs test_keeper_four_word_command/test.py::test_cmd_conf test_keeper_four_word_command/test.py::test_cmd_cons test_keeper_four_word_command/test.py::test_cmd_crst test_keeper_four_word_command/test.py::test_cmd_csnp test_keeper_four_word_command/test.py::test_cmd_dump test_keeper_four_word_command/test.py::test_cmd_isro test_keeper_four_word_command/test.py::test_cmd_lgif test_keeper_four_word_command/test.py::test_cmd_mntr test_keeper_four_word_command/test.py::test_cmd_rqld test_keeper_four_word_command/test.py::test_cmd_ruok test_keeper_four_word_command/test.py::test_cmd_srst test_keeper_four_word_command/test.py::test_cmd_srvr test_keeper_four_word_command/test.py::test_cmd_stat test_keeper_four_word_command/test.py::test_cmd_wchc test_keeper_four_word_command/test.py::test_cmd_wchp test_keeper_four_word_command/test.py::test_cmd_wchs test_keeper_four_word_command/test.py::test_cmd_ydld test_keeper_four_word_command/test_allow_list.py::test_allow_list test_keeper_mntr_pressure/test.py::test_aggressive_mntr test_keeper_nodes_move/test.py::test_node_move test_keeper_reconfig_replace_leader_in_one_command/test.py::test_reconfig_replace_leader_in_one_command test_keeper_session/test.py::test_session_close_shutdown test_keeper_session/test.py::test_session_timeout test_keeper_snapshot_on_exit/test.py::test_snapshot_on_exit 'test_log_family_s3/test.py::test_log_family_s3[Log]' 'test_log_family_s3/test.py::test_log_family_s3[StripeLog]' 'test_log_family_s3/test.py::test_log_family_s3[TinyLog]' test_log_family_s3/test.py::test_stripe_log_truncate test_logs_level/test.py::test_check_client_logs_level test_mask_sensitive_info/test.py::test_backup_table test_mask_sensitive_info/test.py::test_backup_to_s3 test_mask_sensitive_info/test.py::test_create_alter_user test_mask_sensitive_info/test.py::test_create_database test_mask_sensitive_info/test.py::test_create_dictionary test_mask_sensitive_info/test.py::test_create_table test_mask_sensitive_info/test.py::test_encryption_functions test_mask_sensitive_info/test.py::test_on_cluster test_mask_sensitive_info/test.py::test_table_function_ways_to_call test_mask_sensitive_info/test.py::test_table_functions test_materialized_view_restart_server/test.py::test_materialized_view_with_subquery test_memory_limit_observer/test.py::test_memory_usage_doesnt_include_page_cache_size test_memory_limit_observer/test.py::test_observe_memory_limit test_merge_table_over_distributed/test.py::test_filtering test_merge_table_over_distributed/test.py::test_global_in test_merge_table_over_distributed/test.py::test_select_table_name_from_merge_over_distributed test_modify_engine_on_restart/test_unusual_path.py::test_modify_engine_on_restart_with_unusual_path test_modify_engine_on_restart/test_zk_path_exists.py::test_modify_engine_fails_if_zk_path_exists test_multi_access_storage_role_management/test.py::test_quotas test_multi_access_storage_role_management/test.py::test_role_from_different_storages test_multi_access_storage_role_management/test.py::test_roles test_multi_access_storage_role_management/test.py::test_settings_profiles test_multi_access_storage_role_management/test.py::test_users test_mutations_with_merge_tree/test.py::test_mutations_with_merge_background_task test_mutations_with_merge_tree/test.py::test_mutations_with_truncate_table  -vvv" altinityinfra/integration-tests-runner:cf95077f4609 '.
Start tests
============================= test session starts ==============================
platform linux -- Python 3.10.12, pytest-7.4.4, pluggy-1.5.0 -- /usr/bin/python3
cachedir: .pytest_cache
rootdir: /ClickHouse/tests/integration
configfile: pytest.ini
plugins: repeat-0.9.4, order-1.0.1, random-0.2, timeout-2.2.0, reportlog-0.4.0, xdist-3.5.0
timeout: 900.0s
timeout method: signal
timeout func_only: False
created: 10/10 workers
10 workers [100 items]

scheduling tests via LoadFileScheduling

test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node0-True] 
test_multi_access_storage_role_management/test.py::test_quotas 
test_keeper_client/test.py::test_base_commands 
test_mask_sensitive_info/test.py::test_backup_table 
test_keeper_four_word_command/test.py::test_cmd_clrs 
test_keeper_back_to_back/test.py::test_concurrent_watches 
test_log_family_s3/test.py::test_log_family_s3[Log] 
test_merge_table_over_distributed/test.py::test_filtering 
test_kafka_bad_messages/test.py::test_bad_messages_parsing_exception 
test_filesystem_cache/test.py::test_caches_with_the_same_configuration[node] 
[gw9] [  1%] PASSED test_merge_table_over_distributed/test.py::test_filtering 
test_merge_table_over_distributed/test.py::test_global_in 
[gw9] [  2%] PASSED test_merge_table_over_distributed/test.py::test_global_in 
test_merge_table_over_distributed/test.py::test_select_table_name_from_merge_over_distributed 
[gw9] [  3%] PASSED test_merge_table_over_distributed/test.py::test_select_table_name_from_merge_over_distributed 
[gw4] [  4%] PASSED test_filesystem_cache/test.py::test_caches_with_the_same_configuration[node] 
test_filesystem_cache/test.py::test_caches_with_the_same_configuration_2[node_caches_with_same_path] 
[gw4] [  5%] PASSED test_filesystem_cache/test.py::test_caches_with_the_same_configuration_2[node_caches_with_same_path] 
test_filesystem_cache/test.py::test_custom_cached_disk 
[gw5] [  6%] PASSED test_multi_access_storage_role_management/test.py::test_quotas 
test_multi_access_storage_role_management/test.py::test_role_from_different_storages 
[gw0] [  7%] PASSED test_keeper_four_word_command/test.py::test_cmd_clrs 
test_keeper_four_word_command/test.py::test_cmd_conf 
[gw0] [  8%] PASSED test_keeper_four_word_command/test.py::test_cmd_conf 
test_keeper_four_word_command/test.py::test_cmd_cons 
[gw0] [  9%] PASSED test_keeper_four_word_command/test.py::test_cmd_cons 
test_keeper_four_word_command/test.py::test_cmd_crst 
[gw0] [ 10%] PASSED test_keeper_four_word_command/test.py::test_cmd_crst 
test_keeper_four_word_command/test.py::test_cmd_csnp 
[gw0] [ 11%] PASSED test_keeper_four_word_command/test.py::test_cmd_csnp 
test_keeper_four_word_command/test.py::test_cmd_dump 
[gw0] [ 12%] PASSED test_keeper_four_word_command/test.py::test_cmd_dump 
test_keeper_four_word_command/test.py::test_cmd_isro 
[gw0] [ 13%] PASSED test_keeper_four_word_command/test.py::test_cmd_isro 
test_keeper_four_word_command/test.py::test_cmd_lgif 
[gw0] [ 14%] PASSED test_keeper_four_word_command/test.py::test_cmd_lgif 
test_keeper_four_word_command/test.py::test_cmd_mntr 
[gw0] [ 15%] PASSED test_keeper_four_word_command/test.py::test_cmd_mntr 
test_keeper_four_word_command/test.py::test_cmd_rqld 
[gw2] [ 16%] PASSED test_keeper_client/test.py::test_base_commands 
test_keeper_client/test.py::test_big_family 
[gw2] [ 17%] PASSED test_keeper_client/test.py::test_big_family 
test_keeper_client/test.py::test_delete_stale_backups 
[gw2] [ 18%] PASSED test_keeper_client/test.py::test_delete_stale_backups 
test_keeper_client/test.py::test_find_super_nodes 
[gw2] [ 19%] PASSED test_keeper_client/test.py::test_find_super_nodes 
test_keeper_client/test.py::test_four_letter_word_commands 
[gw2] [ 20%] PASSED test_keeper_client/test.py::test_four_letter_word_commands 
test_keeper_client/test.py::test_get_all_children_number 
[gw2] [ 21%] PASSED test_keeper_client/test.py::test_get_all_children_number 
test_keeper_client/test.py::test_quoted_argument_parsing 
[gw2] [ 22%] PASSED test_keeper_client/test.py::test_quoted_argument_parsing 
test_keeper_client/test.py::test_rm_with_version 
[gw2] [ 23%] PASSED test_keeper_client/test.py::test_rm_with_version 
test_keeper_client/test.py::test_rm_without_version 
[gw2] [ 24%] PASSED test_keeper_client/test.py::test_rm_without_version 
test_keeper_client/test.py::test_set_with_version 
[gw2] [ 25%] PASSED test_keeper_client/test.py::test_set_with_version 
test_keeper_client/test.py::test_set_without_version 
[gw2] [ 26%] PASSED test_keeper_client/test.py::test_set_without_version 
[gw0] [ 27%] PASSED test_keeper_four_word_command/test.py::test_cmd_rqld 
test_keeper_four_word_command/test.py::test_cmd_ruok 
[gw0] [ 28%] PASSED test_keeper_four_word_command/test.py::test_cmd_ruok 
test_keeper_four_word_command/test.py::test_cmd_srst 
[gw0] [ 29%] PASSED test_keeper_four_word_command/test.py::test_cmd_srst 
test_keeper_four_word_command/test.py::test_cmd_srvr 
[gw0] [ 30%] PASSED test_keeper_four_word_command/test.py::test_cmd_srvr 
test_keeper_four_word_command/test.py::test_cmd_stat 
[gw0] [ 31%] PASSED test_keeper_four_word_command/test.py::test_cmd_stat 
test_keeper_four_word_command/test.py::test_cmd_wchc 
[gw0] [ 32%] PASSED test_keeper_four_word_command/test.py::test_cmd_wchc 
test_keeper_four_word_command/test.py::test_cmd_wchp 
[gw0] [ 33%] PASSED test_keeper_four_word_command/test.py::test_cmd_wchp 
test_keeper_four_word_command/test.py::test_cmd_wchs 
[gw0] [ 34%] PASSED test_keeper_four_word_command/test.py::test_cmd_wchs 
test_keeper_four_word_command/test.py::test_cmd_ydld 
[gw5] [ 35%] PASSED test_multi_access_storage_role_management/test.py::test_role_from_different_storages 
test_multi_access_storage_role_management/test.py::test_roles 
test_jbod_balancer/test.py::test_jbod_balanced_merge 
[gw6] [ 36%] PASSED test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node0-True] 
test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node1-False] 
[gw0] [ 37%] PASSED test_keeper_four_word_command/test.py::test_cmd_ydld 
test_join_set_family_s3/test.py::test_join_s3 
[gw5] [ 38%] PASSED test_multi_access_storage_role_management/test.py::test_roles 
test_multi_access_storage_role_management/test.py::test_settings_profiles 
[gw6] [ 39%] PASSED test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node1-False] 
test_failed_mutations/test.py::test_exponential_backoff_with_replicated_tree 
test_keeper_session/test.py::test_session_close_shutdown 
[gw5] [ 40%] PASSED test_multi_access_storage_role_management/test.py::test_settings_profiles 
test_multi_access_storage_role_management/test.py::test_users 
[gw5] [ 41%] PASSED test_multi_access_storage_role_management/test.py::test_users 
[gw6] [ 42%] PASSED test_failed_mutations/test.py::test_exponential_backoff_with_replicated_tree 
test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[False] 
[gw6] [ 43%] PASSED test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[False] 
test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[True] 
test_fetch_partition_with_outdated_parts/test.py::test_fetch_partition_with_outdated_parts 
[gw4] [ 44%] PASSED test_filesystem_cache/test.py::test_custom_cached_disk 
test_filesystem_cache/test.py::test_force_filesystem_cache_on_merges 
[gw6] [ 45%] PASSED test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[True] 
test_http_native/test.py::test_http_native_returns_timezone 
[gw3] [ 46%] PASSED test_keeper_back_to_back/test.py::test_concurrent_watches 
test_keeper_back_to_back/test.py::test_end_of_session 
[gw3] [ 47%] PASSED test_keeper_back_to_back/test.py::test_end_of_session 
test_keeper_back_to_back/test.py::test_end_of_watches_session 
[gw3] [ 48%] PASSED test_keeper_back_to_back/test.py::test_end_of_watches_session 
test_keeper_back_to_back/test.py::test_multitransactions 
[gw3] [ 49%] PASSED test_keeper_back_to_back/test.py::test_multitransactions 
test_keeper_back_to_back/test.py::test_random_requests 
[gw4] [ 50%] PASSED test_filesystem_cache/test.py::test_force_filesystem_cache_on_merges 
test_filesystem_cache/test.py::test_keep_up_size_ratio 
[gw4] [ 51%] PASSED test_filesystem_cache/test.py::test_keep_up_size_ratio 
test_filesystem_cache/test.py::test_parallel_cache_loading_on_startup[node] 
[gw4] [ 52%] PASSED test_filesystem_cache/test.py::test_parallel_cache_loading_on_startup[node] 
test_filesystem_cache/test.py::test_system_sync_filesystem_cache 
[gw4] [ 53%] PASSED test_filesystem_cache/test.py::test_system_sync_filesystem_cache 
test_keeper_mntr_pressure/test.py::test_aggressive_mntr 
[gw3] [ 54%] PASSED test_keeper_back_to_back/test.py::test_random_requests 
test_keeper_back_to_back/test.py::test_sequential_nodes 
[gw3] [ 55%] PASSED test_keeper_back_to_back/test.py::test_sequential_nodes 
test_keeper_back_to_back/test.py::test_simple_commands 
[gw3] [ 56%] PASSED test_keeper_back_to_back/test.py::test_simple_commands 
test_keeper_back_to_back/test.py::test_stats 
[gw3] [ 57%] PASSED test_keeper_back_to_back/test.py::test_stats 
test_keeper_back_to_back/test.py::test_watchers 
[gw5] [ 58%] PASSED test_fetch_partition_with_outdated_parts/test.py::test_fetch_partition_with_outdated_parts 
[gw9] [ 59%] PASSED test_jbod_balancer/test.py::test_jbod_balanced_merge 
test_jbod_balancer/test.py::test_replicated_balanced_merge_fetch 
[gw0] [ 60%] PASSED test_keeper_session/test.py::test_session_close_shutdown 
test_keeper_session/test.py::test_session_timeout 
[gw0] [ 61%] PASSED test_keeper_session/test.py::test_session_timeout 
[gw3] [ 62%] PASSED test_keeper_back_to_back/test.py::test_watchers 
test_file_schema_inference_cache/test.py::test 
test_grant_and_revoke/test_without_table_engine_grant.py::test_table_engine_and_source_grant 
[gw6] [ 63%] PASSED test_http_native/test.py::test_http_native_returns_timezone 
test_keeper_snapshot_on_exit/test.py::test_snapshot_on_exit 
test_intersecting_parts/test.py::test_intersect_parts_when_restart 
[gw9] [ 64%] PASSED test_jbod_balancer/test.py::test_replicated_balanced_merge_fetch 
test_memory_limit_observer/test.py::test_memory_usage_doesnt_include_page_cache_size 
[gw5] [ 65%] PASSED test_grant_and_revoke/test_without_table_engine_grant.py::test_table_engine_and_source_grant 
test_keeper_force_recovery_single_node/test.py::test_cluster_recovery 
[gw1] [ 66%] PASSED test_mask_sensitive_info/test.py::test_backup_table 
test_mask_sensitive_info/test.py::test_backup_to_s3 
[gw1] [ 67%] PASSED test_mask_sensitive_info/test.py::test_backup_to_s3 
test_mask_sensitive_info/test.py::test_create_alter_user 
[gw1] [ 68%] PASSED test_mask_sensitive_info/test.py::test_create_alter_user 
test_mask_sensitive_info/test.py::test_create_database 
[gw6] [ 69%] PASSED test_intersecting_parts/test.py::test_intersect_parts_when_restart 
[gw1] [ 70%] PASSED test_mask_sensitive_info/test.py::test_create_database 
test_mask_sensitive_info/test.py::test_create_dictionary 
[gw0] [ 71%] PASSED test_file_schema_inference_cache/test.py::test 
[gw1] [ 72%] PASSED test_mask_sensitive_info/test.py::test_create_dictionary 
test_mask_sensitive_info/test.py::test_create_table 
test_materialized_view_restart_server/test.py::test_materialized_view_with_subquery 
test_keeper_four_word_command/test_allow_list.py::test_allow_list 
[gw1] [ 73%] PASSED test_mask_sensitive_info/test.py::test_create_table 
test_mask_sensitive_info/test.py::test_encryption_functions 
[gw9] [ 74%] PASSED test_memory_limit_observer/test.py::test_memory_usage_doesnt_include_page_cache_size 
test_memory_limit_observer/test.py::test_observe_memory_limit 
[gw1] [ 75%] PASSED test_mask_sensitive_info/test.py::test_encryption_functions 
test_mask_sensitive_info/test.py::test_on_cluster 
[gw3] [ 76%] PASSED test_keeper_snapshot_on_exit/test.py::test_snapshot_on_exit 
[gw1] [ 77%] PASSED test_mask_sensitive_info/test.py::test_on_cluster 
test_mask_sensitive_info/test.py::test_table_function_ways_to_call 
[gw1] [ 78%] PASSED test_mask_sensitive_info/test.py::test_table_function_ways_to_call 
test_mask_sensitive_info/test.py::test_table_functions 
test_logs_level/test.py::test_check_client_logs_level 
[gw8] [ 79%] PASSED test_kafka_bad_messages/test.py::test_bad_messages_parsing_exception 
test_kafka_bad_messages/test.py::test_bad_messages_parsing_stream 
[gw9] [ 80%] PASSED test_memory_limit_observer/test.py::test_observe_memory_limit 
[gw4] [ 81%] PASSED test_keeper_mntr_pressure/test.py::test_aggressive_mntr 
test_keeper_nodes_move/test.py::test_node_move 
[gw1] [ 82%] PASSED test_mask_sensitive_info/test.py::test_table_functions 
[gw0] [ 83%] PASSED test_materialized_view_restart_server/test.py::test_materialized_view_with_subquery 
test_modify_engine_on_restart/test_unusual_path.py::test_modify_engine_on_restart_with_unusual_path 
[gw5] [ 84%] PASSED test_keeper_force_recovery_single_node/test.py::test_cluster_recovery 
[gw6] [ 85%] PASSED test_keeper_four_word_command/test_allow_list.py::test_allow_list 
test_modify_engine_on_restart/test_zk_path_exists.py::test_modify_engine_fails_if_zk_path_exists 
[gw3] [ 86%] PASSED test_logs_level/test.py::test_check_client_logs_level 
[gw7] [ 87%] ERROR test_log_family_s3/test.py::test_log_family_s3[Log] 
test_log_family_s3/test.py::test_log_family_s3[StripeLog] 
[gw7] [ 88%] ERROR test_log_family_s3/test.py::test_log_family_s3[StripeLog] 
test_log_family_s3/test.py::test_log_family_s3[TinyLog] 
[gw7] [ 89%] ERROR test_log_family_s3/test.py::test_log_family_s3[TinyLog] 
test_log_family_s3/test.py::test_stripe_log_truncate 
[gw7] [ 90%] ERROR test_log_family_s3/test.py::test_stripe_log_truncate 
[gw0] [ 91%] PASSED test_modify_engine_on_restart/test_unusual_path.py::test_modify_engine_on_restart_with_unusual_path 
[gw5] [ 92%] PASSED test_modify_engine_on_restart/test_zk_path_exists.py::test_modify_engine_fails_if_zk_path_exists 
[gw4] [ 93%] PASSED test_keeper_nodes_move/test.py::test_node_move 
test_keeper_reconfig_replace_leader_in_one_command/test.py::test_reconfig_replace_leader_in_one_command 
[gw2] [ 94%] ERROR test_join_set_family_s3/test.py::test_join_s3 
test_join_set_family_s3/test.py::test_set_s3 
[gw2] [ 95%] ERROR test_join_set_family_s3/test.py::test_set_s3 
test_mutations_with_merge_tree/test.py::test_mutations_with_merge_background_task 
[gw2] [ 96%] PASSED test_mutations_with_merge_tree/test.py::test_mutations_with_merge_background_task 
test_mutations_with_merge_tree/test.py::test_mutations_with_truncate_table 
[gw4] [ 97%] PASSED test_keeper_reconfig_replace_leader_in_one_command/test.py::test_reconfig_replace_leader_in_one_command 
[gw2] [ 98%] PASSED test_mutations_with_merge_tree/test.py::test_mutations_with_truncate_table 
[gw8] [ 99%] PASSED test_kafka_bad_messages/test.py::test_bad_messages_parsing_stream 
test_kafka_bad_messages/test.py::test_bad_messages_to_mv 
[gw8] [100%] PASSED test_kafka_bad_messages/test.py::test_bad_messages_to_mv 

==================================== ERRORS ====================================
__________________ ERROR at setup of test_log_family_s3[Log] ___________________
[gw7] linux -- Python 3.10.12 /usr/bin/python3

    @pytest.fixture(scope="module")
    def cluster():
        try:
            cluster = ClickHouseCluster(__file__)
            cluster.add_instance(
                "node",
                main_configs=["configs/storage_configuration.xml", "configs/ssl.xml"],
                with_minio=True,
            )
            logging.info("Starting cluster...")
>           cluster.start()

test_log_family_s3/test.py:18: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
helpers/cluster.py:2831: in start
    retry(log_function=logging_pulling_images)(run_and_check)(
helpers/retry_decorator.py:28: in wrapper
    raise e
helpers/retry_decorator.py:19: in wrapper
    func(*args, **kwargs)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw7/.env', '--project-name', 'roottestlogfamilys3_gw7', '--file', ...]
env = None, shell = False, stdout = -1, stderr = -1, timeout = 900
nothrow = False, detach = False

    def run_and_check(
        args,
        env=None,
        shell=False,
        stdout=subprocess.PIPE,
        stderr=subprocess.PIPE,
        timeout=300,
        nothrow=False,
        detach=False,
    ):
        if detach:
            subprocess.Popen(
                args,
                stdout=subprocess.DEVNULL,
                stderr=subprocess.DEVNULL,
                env=env,
                shell=shell,
            )
            return
    
        logging.debug(f"Command:{args}")
        res = subprocess.run(
            args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout
        )
        out = res.stdout.decode("utf-8", "ignore")
        err = res.stderr.decode("utf-8", "ignore")
        # check_call(...) from subprocess does not print stderr, so we do it manually
        for outline in out.splitlines():
            logging.debug(f"Stdout:{outline}")
        for errline in err.splitlines():
            logging.debug(f"Stderr:{errline}")
        if res.returncode != 0:
            logging.debug(f"Exitcode:{res.returncode}")
            if env:
                logging.debug(f"Env:{env}")
            if not nothrow:
>               raise Exception(
                    f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}"
                )
E               Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw7/.env', '--project-name', 'roottestlogfamilys3_gw7', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw7/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2   ... 
E               Pulling proxy1   ... 
E               Pulling minio1   ... 
E               Pulling node     ... 
E               Pulling resolver ... 
E               Pulling node     ... pulling from altinityinfra/integr...
E               Pulling proxy1   ... pulling from altinityinfra/s3-proxy
E               Pulling proxy2   ... pulling from altinityinfra/s3-proxy
E               Pulling resolver ... pulling from altinityinfra/python...
E               Pulling node     ... digest: sha256:2ea9da862c215fd684...
E               Pulling node     ... status: image is up to date for a...
E               Pulling proxy1   ... digest: sha256:2c143e57962bb1494a...
E               Pulling proxy1   ... status: image is up to date for a...
E               Pulling node     ... done
E               Pulling proxy1   ... done
E               Pulling proxy2   ... digest: sha256:2c143e57962bb1494a...
E               Pulling proxy2   ... status: image is up to date for a...
E               Pulling proxy2   ... done
E               Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d...
E               Pulling resolver ... status: image is up to date for a...
E               Pulling resolver ... done
E               Pulling minio1   ... error
E               
E               ERROR: for minio1  pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied
E               pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied

helpers/cluster.py:129: Exception
---------------------------- Captured stdout setup -----------------------------
Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml
---------------------------- Captured stderr setup -----------------------------
Traceback (most recent call last):
  File "/ClickHouse/tests/integration/helpers/cluster.py", line 2831, in start
    retry(log_function=logging_pulling_images)(run_and_check)(
  File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 28, in wrapper
    raise e
  File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 19, in wrapper
    func(*args, **kwargs)
  File "/ClickHouse/tests/integration/helpers/cluster.py", line 129, in run_and_check
    raise Exception(
Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw7/.env', '--project-name', 'roottestlogfamilys3_gw7', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw7/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2   ... 
Pulling proxy1   ... 
Pulling minio1   ... 
Pulling node     ... 
Pulling resolver ... 
Pulling node     ... pulling from altinityinfra/integr...
Pulling proxy1   ... pulling from altinityinfra/s3-proxy
Pulling proxy2   ... pulling from altinityinfra/s3-proxy
Pulling resolver ... pulling from altinityinfra/python...
Pulling node     ... digest: sha256:2ea9da862c215fd684...
Pulling node     ... status: image is up to date for a...
Pulling proxy1   ... digest: sha256:2c143e57962bb1494a...
Pulling proxy1   ... status: image is up to date for a...
Pulling node     ... done
Pulling proxy1   ... done
Pulling proxy2   ... digest: sha256:2c143e57962bb1494a...
Pulling proxy2   ... status: image is up to date for a...
Pulling proxy2   ... done
Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d...
Pulling resolver ... status: image is up to date for a...
Pulling resolver ... done
Pulling minio1   ... error

ERROR: for minio1  pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied
pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied

------------------------------ Captured log setup ------------------------------
2026-09-30 17:12:27 [ 536 ] DEBUG : Command:['docker ps | wc -l'] (cluster.py:113, run_and_check)
2026-09-30 17:12:27 [ 536 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check)
2026-09-30 17:12:27 [ 536 ] DEBUG : No running containers (conftest.py:95, cleanup_environment)
2026-09-30 17:12:27 [ 536 ] DEBUG : Pruning Docker networks (conftest.py:97, cleanup_environment)
2026-09-30 17:12:27 [ 536 ] DEBUG : Command:['docker network prune --force'] (cluster.py:113, run_and_check)
2026-09-30 17:12:27 [ 536 ] DEBUG : Command:["sysctl net.ipv4.ip_local_port_range='55000 65535'"] (cluster.py:113, run_and_check)
2026-09-30 17:12:27 [ 536 ] DEBUG : Stdout:net.ipv4.ip_local_port_range = 55000 65535 (cluster.py:121, run_and_check)
2026-09-30 17:12:27 [ 536 ] DEBUG : ENV                  DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 (cluster.py:446, __init__)
2026-09-30 17:12:27 [ 536 ] DEBUG : ENV         CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse (cluster.py:446, __init__)
2026-09-30 17:12:27 [ 536 ] DEBUG : ENV                             MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 (cluster.py:446, __init__)
2026-09-30 17:12:27 [ 536 ] DEBUG : ENV                        JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true (cluster.py:446, __init__)
2026-09-30 17:12:27 [ 536 ] DEBUG : ENV                             TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 (cluster.py:446, __init__)
2026-09-30 17:12:27 [ 536 ] DEBUG : ENV                                 HOSTNAME 76c92d12e6d5 (cluster.py:446, __init__)
2026-09-30 17:12:27 [ 536 ] DEBUG : ENV                                    SHLVL 0 (cluster.py:446, __init__)
2026-09-30 17:12:27 [ 536 ] DEBUG : ENV                                     HOME /root (cluster.py:446, __init__)
2026-09-30 17:12:27 [ 536 ] DEBUG : ENV                                   OLDPWD / (cluster.py:446, __init__)
2026-09-30 17:12:27 [ 536 ] DEBUG : ENV                        DOCKER_HELPER_TAG 2cffe1eae894 (cluster.py:446, __init__)
2026-09-30 17:12:27 [ 536 ] DEBUG : ENV                         PYTHONUNBUFFERED 1 (cluster.py:446, __init__)
2026-09-30 17:12:27 [ 536 ] DEBUG : ENV                 DOCKER_PYTHON_BOTTLE_TAG caad4729259e (cluster.py:446, __init__)
2026-09-30 17:12:27 [ 536 ] DEBUG : ENV                            UBSAN_OPTIONS print_stacktrace=1 (cluster.py:446, __init__)
2026-09-30 17:12:27 [ 536 ] DEBUG : ENV                           PYTEST_ADDOPTS --dist=loadfile -n 10  -rfEps --run-id=0 --color=no --durations=0 'test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node0-True]' 'test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node1-False]' test_failed_mutations/test.py::test_exponential_backoff_with_replicated_tree 'test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[False]' 'test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[True]' test_fetch_partition_with_outdated_parts/test.py::test_fetch_partition_with_outdated_parts test_file_schema_inference_cache/test.py::test 'test_filesystem_cache/test.py::test_caches_with_the_same_configuration[node]' 'test_filesystem_cache/test.py::test_caches_with_the_same_configuration_2[node_caches_with_same_path]' test_filesystem_cache/test.py::test_custom_cached_disk test_filesystem_cache/test.py::test_force_filesystem_cache_on_merges test_filesystem_cache/test.py::test_keep_up_size_ratio 'test_filesystem_cache/test.py::test_parallel_cache_loading_on_startup[node]' test_filesystem_cache/test.py::test_system_sync_filesystem_cache test_grant_and_revoke/test_without_table_engine_grant.py::test_table_engine_and_source_grant test_http_native/test.py::test_http_native_returns_timezone test_intersecting_parts/test.py::test_intersect_parts_when_restart test_jbod_balancer/test.py::test_jbod_balanced_merge test_jbod_balancer/test.py::test_replicated_balanced_merge_fetch test_join_set_family_s3/test.py::test_join_s3 test_join_set_family_s3/test.py::test_set_s3 test_kafka_bad_messages/test.py::test_bad_messages_parsing_exception test_kafka_bad_messages/test.py::test_bad_messages_parsing_stream test_kafka_bad_messages/test.py::test_bad_messages_to_mv test_keeper_back_to_back/test.py::test_concurrent_watches test_keeper_back_to_back/test.py::test_end_of_session test_keeper_back_to_back/test.py::test_end_of_watches_session test_keeper_back_to_back/test.py::test_multitransactions test_keeper_back_to_back/test.py::test_random_requests test_keeper_back_to_back/test.py::test_sequential_nodes test_keeper_back_to_back/test.py::test_simple_commands test_keeper_back_to_back/test.py::test_stats test_keeper_back_to_back/test.py::test_watchers test_keeper_client/test.py::test_base_commands test_keeper_client/test.py::test_big_family test_keeper_client/test.py::test_delete_stale_backups test_keeper_client/test.py::test_find_super_nodes test_keeper_client/test.py::test_four_letter_word_commands test_keeper_client/test.py::test_get_all_children_number test_keeper_client/test.py::test_quoted_argument_parsing test_keeper_client/test.py::test_rm_with_version test_keeper_client/test.py::test_rm_without_version test_keeper_client/test.py::test_set_with_version test_keeper_client/test.py::test_set_without_version test_keeper_force_recovery_single_node/test.py::test_cluster_recovery test_keeper_four_word_command/test.py::test_cmd_clrs test_keeper_four_word_command/test.py::test_cmd_conf test_keeper_four_word_command/test.py::test_cmd_cons test_keeper_four_word_command/test.py::test_cmd_crst test_keeper_four_word_command/test.py::test_cmd_csnp test_keeper_four_word_command/test.py::test_cmd_dump test_keeper_four_word_command/test.py::test_cmd_isro test_keeper_four_word_command/test.py::test_cmd_lgif test_keeper_four_word_command/test.py::test_cmd_mntr test_keeper_four_word_command/test.py::test_cmd_rqld test_keeper_four_word_command/test.py::test_cmd_ruok test_keeper_four_word_command/test.py::test_cmd_srst test_keeper_four_word_command/test.py::test_cmd_srvr test_keeper_four_word_command/test.py::test_cmd_stat test_keeper_four_word_command/test.py::test_cmd_wchc test_keeper_four_word_command/test.py::test_cmd_wchp test_keeper_four_word_command/test.py::test_cmd_wchs test_keeper_four_word_command/test.py::test_cmd_ydld test_keeper_four_word_command/test_allow_list.py::test_allow_list test_keeper_mntr_pressure/test.py::test_aggressive_mntr test_keeper_nodes_move/test.py::test_node_move test_keeper_reconfig_replace_leader_in_one_command/test.py::test_reconfig_replace_leader_in_one_command test_keeper_session/test.py::test_session_close_shutdown test_keeper_session/test.py::test_session_timeout test_keeper_snapshot_on_exit/test.py::test_snapshot_on_exit 'test_log_family_s3/test.py::test_log_family_s3[Log]' 'test_log_family_s3/test.py::test_log_family_s3[StripeLog]' 'test_log_family_s3/test.py::test_log_family_s3[TinyLog]' test_log_family_s3/test.py::test_stripe_log_truncate test_logs_level/test.py::test_check_client_logs_level test_mask_sensitive_info/test.py::test_backup_table test_mask_sensitive_info/test.py::test_backup_to_s3 test_mask_sensitive_info/test.py::test_create_alter_user test_mask_sensitive_info/test.py::test_create_database test_mask_sensitive_info/test.py::test_create_dictionary test_mask_sensitive_info/test.py::test_create_table test_mask_sensitive_info/test.py::test_encryption_functions test_mask_sensitive_info/test.py::test_on_cluster test_mask_sensitive_info/test.py::test_table_function_ways_to_call test_mask_sensitive_info/test.py::test_table_functions test_materialized_view_restart_server/test.py::test_materialized_view_with_subquery test_memory_limit_observer/test.py::test_memory_usage_doesnt_include_page_cache_size test_memory_limit_observer/test.py::test_observe_memory_limit test_merge_table_over_distributed/test.py::test_filtering test_merge_table_over_distributed/test.py::test_global_in test_merge_table_over_distributed/test.py::test_select_table_name_from_merge_over_distributed test_modify_engine_on_restart/test_unusual_path.py::test_modify_engine_on_restart_with_unusual_path test_modify_engine_on_restart/test_zk_path_exists.py::test_modify_engine_fails_if_zk_path_exists test_multi_access_storage_role_management/test.py::test_quotas test_multi_access_storage_role_management/test.py::test_role_from_different_storages test_multi_access_storage_role_management/test.py::test_roles test_multi_access_storage_role_management/test.py::test_settings_profiles test_multi_access_storage_role_management/test.py::test_users test_mutations_with_merge_tree/test.py::test_mutations_with_merge_background_task test_mutations_with_merge_tree/test.py::test_mutations_with_truncate_table  -vvv (cluster.py:446, __init__)
2026-09-30 17:12:27 [ 536 ] DEBUG : ENV    CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge (cluster.py:446, __init__)
2026-09-30 17:12:27 [ 536 ] DEBUG : ENV                     COMPOSE_HTTP_TIMEOUT 600 (cluster.py:446, __init__)
2026-09-30 17:12:27 [ 536 ] DEBUG : ENV              DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 (cluster.py:446, __init__)
2026-09-30 17:12:27 [ 536 ] DEBUG : ENV                 DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d (cluster.py:446, __init__)
2026-09-30 17:12:27 [ 536 ] DEBUG : ENV         CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse (cluster.py:446, __init__)
2026-09-30 17:12:27 [ 536 ] DEBUG : ENV               DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 (cluster.py:446, __init__)
2026-09-30 17:12:27 [ 536 ] DEBUG : ENV                                     PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin (cluster.py:446, __init__)
2026-09-30 17:12:27 [ 536 ] DEBUG : ENV             DOCKER_KERBERIZED_HADOOP_TAG latest (cluster.py:446, __init__)
2026-09-30 17:12:27 [ 536 ] DEBUG : ENV                           DOCKER_CHANNEL stable (cluster.py:446, __init__)
2026-09-30 17:12:27 [ 536 ] DEBUG : ENV                    DOCKER_CLIENT_TIMEOUT 300 (cluster.py:446, __init__)
2026-09-30 17:12:27 [ 536 ] DEBUG : ENV        DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 (cluster.py:446, __init__)
2026-09-30 17:12:27 [ 536 ] DEBUG : ENV                     DOCKER_NGINX_DAV_TAG b55ac9cd7519 (cluster.py:446, __init__)
2026-09-30 17:12:27 [ 536 ] DEBUG : ENV           DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e (cluster.py:446, __init__)
2026-09-30 17:12:27 [ 536 ] DEBUG : ENV                                      PWD /ClickHouse/tests/integration (cluster.py:446, __init__)
2026-09-30 17:12:27 [ 536 ] DEBUG : ENV             DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 (cluster.py:446, __init__)
2026-09-30 17:12:27 [ 536 ] DEBUG : ENV       CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge (cluster.py:446, __init__)
2026-09-30 17:12:27 [ 536 ] DEBUG : ENV         CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config (cluster.py:446, __init__)
2026-09-30 17:12:27 [ 536 ] DEBUG : ENV                                       TZ Etc/UTC (cluster.py:446, __init__)
2026-09-30 17:12:27 [ 536 ] DEBUG : ENV                                JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java (cluster.py:446, __init__)
2026-09-30 17:12:27 [ 536 ] DEBUG : ENV                          DOCKER_BASE_TAG b74d853ebe76 (cluster.py:446, __init__)
2026-09-30 17:12:27 [ 536 ] DEBUG : ENV                               SPARK_HOME /spark-3.3.2-bin-hadoop3 (cluster.py:446, __init__)
2026-09-30 17:12:27 [ 536 ] DEBUG : ENV                                 LC_CTYPE C.UTF-8 (cluster.py:446, __init__)
2026-09-30 17:12:27 [ 536 ] DEBUG : ENV                 INTEGRATION_TESTS_RUN_ID 0 (cluster.py:446, __init__)
2026-09-30 17:12:27 [ 536 ] DEBUG : ENV                        WORKER_FREE_PORTS 30350 30351 30352 30353 30354 30355 30356 30357 30358 30359 30360 30361 30362 30363 30364 30365 30366 30367 30368 30369 30370 30371 30372 30373 30374 30375 30376 30377 30378 30379 30380 30381 30382 30383 30384 30385 30386 30387 30388 30389 30390 30391 30392 30393 30394 30395 30396 30397 30398 30399 (cluster.py:446, __init__)
2026-09-30 17:12:27 [ 536 ] DEBUG : ENV                  PYTEST_XDIST_TESTRUNUID 0d0c4a1eede545eebd7db10a4b10eec0 (cluster.py:446, __init__)
2026-09-30 17:12:27 [ 536 ] DEBUG : ENV                      PYTEST_XDIST_WORKER gw7 (cluster.py:446, __init__)
2026-09-30 17:12:27 [ 536 ] DEBUG : ENV                PYTEST_XDIST_WORKER_COUNT 10 (cluster.py:446, __init__)
2026-09-30 17:12:27 [ 536 ] DEBUG : ENV                      PYTEST_CURRENT_TEST test_log_family_s3/test.py::test_log_family_s3[Log] (setup) (cluster.py:446, __init__)
2026-09-30 17:12:27 [ 536 ] DEBUG : CLUSTER INIT base_config_dir:/clickhouse-config (cluster.py:766, __init__)
2026-09-30 17:12:27 [ 536 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1787, add_instance)
2026-09-30 17:12:27 [ 536 ] DEBUG : Cluster name: project_name:roottestlogfamilys3_gw7. Added instance name:node tag:b74d853ebe76 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw7/.env', '--project-name', 'roottestlogfamilys3_gw7', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw7/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:2081, add_instance)
2026-09-30 17:12:27 [ 536 ] INFO : Starting cluster... (test.py:17, cluster)
2026-09-30 17:12:27 [ 536 ] INFO : Running tests in /ClickHouse/tests/integration/test_log_family_s3/test.py (cluster.py:2790, start)
2026-09-30 17:12:27 [ 536 ] DEBUG : Cluster start called. is_up=False (cluster.py:2797, start)
2026-09-30 17:12:27 [ 536 ] DEBUG : Docker networks for project roottestlogfamilys3_gw7 are NETWORK ID   NAME      DRIVER    SCOPE
 (cluster.py:855, print_all_docker_pieces)
2026-09-30 17:12:27 [ 536 ] DEBUG : Docker containers for project roottestlogfamilys3_gw7 are CONTAINER ID   IMAGE     COMMAND   CREATED   STATUS    PORTS     NAMES
 (cluster.py:863, print_all_docker_pieces)
2026-09-30 17:12:28 [ 536 ] DEBUG : Docker volumes for project roottestlogfamilys3_gw7 are DRIVER    VOLUME NAME
 (cluster.py:871, print_all_docker_pieces)
2026-09-30 17:12:28 [ 536 ] DEBUG : Cleanup called (cluster.py:876, cleanup)
2026-09-30 17:12:28 [ 536 ] DEBUG : Docker networks for project roottestlogfamilys3_gw7 are NETWORK ID   NAME      DRIVER    SCOPE
 (cluster.py:855, print_all_docker_pieces)
2026-09-30 17:12:28 [ 536 ] DEBUG : Docker containers for project roottestlogfamilys3_gw7 are CONTAINER ID   IMAGE     COMMAND   CREATED   STATUS    PORTS     NAMES
 (cluster.py:863, print_all_docker_pieces)
2026-09-30 17:12:28 [ 536 ] DEBUG : Docker volumes for project roottestlogfamilys3_gw7 are DRIVER    VOLUME NAME
 (cluster.py:871, print_all_docker_pieces)
2026-09-30 17:12:28 [ 536 ] DEBUG : Command:docker container list --all --filter name='^/roottestlogfamilys3_gw7_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check)
2026-09-30 17:12:28 [ 536 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup)
2026-09-30 17:12:28 [ 536 ] DEBUG : No running containers for project: roottestlogfamilys3_gw7 (cluster.py:904, cleanup)
2026-09-30 17:12:28 [ 536 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup)
2026-09-30 17:12:28 [ 536 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup)
2026-09-30 17:12:28 [ 536 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check)
2026-09-30 17:12:28 [ 536 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check)
2026-09-30 17:12:28 [ 536 ] DEBUG : Setup directory for instance: node (cluster.py:2810, start)
2026-09-30 17:12:28 [ 536 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4538, create_dir)
2026-09-30 17:12:28 [ 536 ] DEBUG : Create directory for common tests configuration (cluster.py:4543, create_dir)
2026-09-30 17:12:28 [ 536 ] DEBUG : Copy common configuration from helpers (cluster.py:4563, create_dir)
2026-09-30 17:12:28 [ 536 ] DEBUG : Generate and write macros file (cluster.py:4606, create_dir)
2026-09-30 17:12:28 [ 536 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_log_family_s3/configs/storage_configuration.xml', '/ClickHouse/tests/integration/test_log_family_s3/configs/ssl.xml'] to /ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw7/node/configs/config.d (cluster.py:4636, create_dir)
2026-09-30 17:12:28 [ 536 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw7/node/database (cluster.py:4653, create_dir)
2026-09-30 17:12:28 [ 536 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw7/node/logs (cluster.py:4664, create_dir)
2026-09-30 17:12:28 [ 536 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] (cluster.py:4750, create_dir)
2026-09-30 17:12:28 [ 536 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw7/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw7/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw7/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw7/.env (cluster.py:86, _create_env_file)
2026-09-30 17:12:28 [ 536 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file)
2026-09-30 17:12:28 [ 536 ] DEBUG : No config file found (config.py:28, find_config_file)
2026-09-30 17:12:28 [ 536 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file)
2026-09-30 17:12:28 [ 536 ] DEBUG : No config file found (config.py:28, find_config_file)
2026-09-30 17:12:28 [ 536 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 825 (connectionpool.py:547, _make_request)
2026-09-30 17:12:28 [ 536 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw7/.env', '--project-name', 'roottestlogfamilys3_gw7', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw7/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check)
2026-09-30 17:13:30 [ 536 ] DEBUG : Stderr:Pulling proxy1   ...  (cluster.py:123, run_and_check)
2026-09-30 17:13:30 [ 536 ] DEBUG : Stderr:Pulling proxy2   ...  (cluster.py:123, run_and_check)
2026-09-30 17:13:30 [ 536 ] DEBUG : Stderr:Pulling minio1   ...  (cluster.py:123, run_and_check)
2026-09-30 17:13:30 [ 536 ] DEBUG : Stderr:Pulling node     ...  (cluster.py:123, run_and_check)
2026-09-30 17:13:30 [ 536 ] DEBUG : Stderr:Pulling resolver ...  (cluster.py:123, run_and_check)
2026-09-30 17:13:30 [ 536 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check)
2026-09-30 17:13:30 [ 536 ] DEBUG : Stderr:Pulling node     ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check)
2026-09-30 17:13:30 [ 536 ] DEBUG : Stderr:Pulling proxy2   ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check)
2026-09-30 17:13:30 [ 536 ] DEBUG : Stderr:Pulling proxy1   ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check)
2026-09-30 17:13:30 [ 536 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check)
2026-09-30 17:13:30 [ 536 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check)
2026-09-30 17:13:30 [ 536 ] DEBUG : Stderr:Pulling proxy2   ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check)
2026-09-30 17:13:30 [ 536 ] DEBUG : Stderr:Pulling proxy2   ... status: image is up to date for a... (cluster.py:123, run_and_check)
2026-09-30 17:13:30 [ 536 ] DEBUG : Stderr:Pulling node     ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check)
2026-09-30 17:13:30 [ 536 ] DEBUG : Stderr:Pulling node     ... status: image is up to date for a... (cluster.py:123, run_and_check)
2026-09-30 17:13:30 [ 536 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check)
2026-09-30 17:13:30 [ 536 ] DEBUG : Stderr:Pulling proxy2   ... done (cluster.py:123, run_and_check)
2026-09-30 17:13:30 [ 536 ] DEBUG : Stderr:Pulling node     ... done (cluster.py:123, run_and_check)
2026-09-30 17:13:30 [ 536 ] DEBUG : Stderr:Pulling proxy1   ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check)
2026-09-30 17:13:30 [ 536 ] DEBUG : Stderr:Pulling proxy1   ... status: image is up to date for a... (cluster.py:123, run_and_check)
2026-09-30 17:13:30 [ 536 ] DEBUG : Stderr:Pulling proxy1   ... done (cluster.py:123, run_and_check)
2026-09-30 17:13:30 [ 536 ] DEBUG : Stderr:Pulling minio1   ... error (cluster.py:123, run_and_check)
2026-09-30 17:13:30 [ 536 ] DEBUG : Stderr: (cluster.py:123, run_and_check)
2026-09-30 17:13:30 [ 536 ] DEBUG : Stderr:ERROR: for minio1  pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check)
2026-09-30 17:13:30 [ 536 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check)
2026-09-30 17:13:30 [ 536 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check)
2026-09-30 17:13:30 [ 536 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw7/.env', '--project-name', 'roottestlogfamilys3_gw7', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw7/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1   ... 
Pulling proxy2   ... 
Pulling minio1   ... 
Pulling node     ... 
Pulling resolver ... 
Pulling resolver ... pulling from altinityinfra/python...
Pulling node     ... pulling from altinityinfra/integr...
Pulling proxy2   ... pulling from altinityinfra/s3-proxy
Pulling proxy1   ... pulling from altinityinfra/s3-proxy
Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d...
Pulling resolver ... status: image is up to date for a...
Pulling proxy2   ... digest: sha256:2c143e57962bb1494a...
Pulling proxy2   ... status: image is up to date for a...
Pulling node     ... digest: sha256:2ea9da862c215fd684...
Pulling node     ... status: image is up to date for a...
Pulling resolver ... done
Pulling proxy2   ... done
Pulling node     ... done
Pulling proxy1   ... digest: sha256:2c143e57962bb1494a...
Pulling proxy1   ... status: image is up to date for a...
Pulling proxy1   ... done
Pulling minio1   ... error

ERROR: for minio1  pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied
pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied
 (cluster.py:2827, logging_pulling_images)
2026-09-30 17:13:32 [ 536 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw7/.env', '--project-name', 'roottestlogfamilys3_gw7', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw7/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check)
2026-09-30 17:14:27 [ 536 ] DEBUG : Stderr:Pulling proxy2   ...  (cluster.py:123, run_and_check)
2026-09-30 17:14:27 [ 536 ] DEBUG : Stderr:Pulling proxy1   ...  (cluster.py:123, run_and_check)
2026-09-30 17:14:27 [ 536 ] DEBUG : Stderr:Pulling minio1   ...  (cluster.py:123, run_and_check)
2026-09-30 17:14:27 [ 536 ] DEBUG : Stderr:Pulling resolver ...  (cluster.py:123, run_and_check)
2026-09-30 17:14:27 [ 536 ] DEBUG : Stderr:Pulling node     ...  (cluster.py:123, run_and_check)
2026-09-30 17:14:27 [ 536 ] DEBUG : Stderr:Pulling proxy2   ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check)
2026-09-30 17:14:27 [ 536 ] DEBUG : Stderr:Pulling node     ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check)
2026-09-30 17:14:27 [ 536 ] DEBUG : Stderr:Pulling proxy1   ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check)
2026-09-30 17:14:27 [ 536 ] DEBUG : Stderr:Pulling proxy2   ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check)
2026-09-30 17:14:27 [ 536 ] DEBUG : Stderr:Pulling proxy2   ... status: image is up to date for a... (cluster.py:123, run_and_check)
2026-09-30 17:14:27 [ 536 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check)
2026-09-30 17:14:27 [ 536 ] DEBUG : Stderr:Pulling proxy2   ... done (cluster.py:123, run_and_check)
2026-09-30 17:14:27 [ 536 ] DEBUG : Stderr:Pulling node     ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check)
2026-09-30 17:14:27 [ 536 ] DEBUG : Stderr:Pulling node     ... status: image is up to date for a... (cluster.py:123, run_and_check)
2026-09-30 17:14:27 [ 536 ] DEBUG : Stderr:Pulling node     ... done (cluster.py:123, run_and_check)
2026-09-30 17:14:27 [ 536 ] DEBUG : Stderr:Pulling proxy1   ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check)
2026-09-30 17:14:27 [ 536 ] DEBUG : Stderr:Pulling proxy1   ... status: image is up to date for a... (cluster.py:123, run_and_check)
2026-09-30 17:14:27 [ 536 ] DEBUG : Stderr:Pulling proxy1   ... done (cluster.py:123, run_and_check)
2026-09-30 17:14:27 [ 536 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check)
2026-09-30 17:14:27 [ 536 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check)
2026-09-30 17:14:27 [ 536 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check)
2026-09-30 17:14:27 [ 536 ] DEBUG : Stderr:Pulling minio1   ... error (cluster.py:123, run_and_check)
2026-09-30 17:14:27 [ 536 ] DEBUG : Stderr: (cluster.py:123, run_and_check)
2026-09-30 17:14:27 [ 536 ] DEBUG : Stderr:ERROR: for minio1  pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check)
2026-09-30 17:14:27 [ 536 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check)
2026-09-30 17:14:27 [ 536 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check)
2026-09-30 17:14:27 [ 536 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw7/.env', '--project-name', 'roottestlogfamilys3_gw7', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw7/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2   ... 
Pulling proxy1   ... 
Pulling minio1   ... 
Pulling resolver ... 
Pulling node     ... 
Pulling proxy2   ... pulling from altinityinfra/s3-proxy
Pulling node     ... pulling from altinityinfra/integr...
Pulling proxy1   ... pulling from altinityinfra/s3-proxy
Pulling proxy2   ... digest: sha256:2c143e57962bb1494a...
Pulling proxy2   ... status: image is up to date for a...
Pulling resolver ... pulling from altinityinfra/python...
Pulling proxy2   ... done
Pulling node     ... digest: sha256:2ea9da862c215fd684...
Pulling node     ... status: image is up to date for a...
Pulling node     ... done
Pulling proxy1   ... digest: sha256:2c143e57962bb1494a...
Pulling proxy1   ... status: image is up to date for a...
Pulling proxy1   ... done
Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d...
Pulling resolver ... status: image is up to date for a...
Pulling resolver ... done
Pulling minio1   ... error

ERROR: for minio1  pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied
pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied
 (cluster.py:2827, logging_pulling_images)
2026-09-30 17:14:30 [ 536 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw7/.env', '--project-name', 'roottestlogfamilys3_gw7', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw7/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check)
2026-09-30 17:15:32 [ 536 ] DEBUG : Stderr:Pulling proxy2   ...  (cluster.py:123, run_and_check)
2026-09-30 17:15:32 [ 536 ] DEBUG : Stderr:Pulling proxy1   ...  (cluster.py:123, run_and_check)
2026-09-30 17:15:32 [ 536 ] DEBUG : Stderr:Pulling minio1   ...  (cluster.py:123, run_and_check)
2026-09-30 17:15:32 [ 536 ] DEBUG : Stderr:Pulling node     ...  (cluster.py:123, run_and_check)
2026-09-30 17:15:32 [ 536 ] DEBUG : Stderr:Pulling resolver ...  (cluster.py:123, run_and_check)
2026-09-30 17:15:32 [ 536 ] DEBUG : Stderr:Pulling proxy1   ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check)
2026-09-30 17:15:32 [ 536 ] DEBUG : Stderr:Pulling proxy2   ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check)
2026-09-30 17:15:32 [ 536 ] DEBUG : Stderr:Pulling proxy1   ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check)
2026-09-30 17:15:32 [ 536 ] DEBUG : Stderr:Pulling proxy1   ... status: image is up to date for a... (cluster.py:123, run_and_check)
2026-09-30 17:15:32 [ 536 ] DEBUG : Stderr:Pulling proxy1   ... done (cluster.py:123, run_and_check)
2026-09-30 17:15:32 [ 536 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check)
2026-09-30 17:15:32 [ 536 ] DEBUG : Stderr:Pulling proxy2   ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check)
2026-09-30 17:15:32 [ 536 ] DEBUG : Stderr:Pulling proxy2   ... status: image is up to date for a... (cluster.py:123, run_and_check)
2026-09-30 17:15:32 [ 536 ] DEBUG : Stderr:Pulling proxy2   ... done (cluster.py:123, run_and_check)
2026-09-30 17:15:32 [ 536 ] DEBUG : Stderr:Pulling node     ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check)
2026-09-30 17:15:32 [ 536 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check)
2026-09-30 17:15:32 [ 536 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check)
2026-09-30 17:15:32 [ 536 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check)
2026-09-30 17:15:32 [ 536 ] DEBUG : Stderr:Pulling node     ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check)
2026-09-30 17:15:32 [ 536 ] DEBUG : Stderr:Pulling node     ... status: image is up to date for a... (cluster.py:123, run_and_check)
2026-09-30 17:15:32 [ 536 ] DEBUG : Stderr:Pulling node     ... done (cluster.py:123, run_and_check)
2026-09-30 17:15:32 [ 536 ] DEBUG : Stderr:Pulling minio1   ... error (cluster.py:123, run_and_check)
2026-09-30 17:15:32 [ 536 ] DEBUG : Stderr: (cluster.py:123, run_and_check)
2026-09-30 17:15:32 [ 536 ] DEBUG : Stderr:ERROR: for minio1  pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check)
2026-09-30 17:15:32 [ 536 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check)
2026-09-30 17:15:32 [ 536 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check)
2026-09-30 17:15:32 [ 536 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw7/.env', '--project-name', 'roottestlogfamilys3_gw7', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw7/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2   ... 
Pulling proxy1   ... 
Pulling minio1   ... 
Pulling node     ... 
Pulling resolver ... 
Pulling proxy1   ... pulling from altinityinfra/s3-proxy
Pulling proxy2   ... pulling from altinityinfra/s3-proxy
Pulling proxy1   ... digest: sha256:2c143e57962bb1494a...
Pulling proxy1   ... status: image is up to date for a...
Pulling proxy1   ... done
Pulling resolver ... pulling from altinityinfra/python...
Pulling proxy2   ... digest: sha256:2c143e57962bb1494a...
Pulling proxy2   ... status: image is up to date for a...
Pulling proxy2   ... done
Pulling node     ... pulling from altinityinfra/integr...
Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d...
Pulling resolver ... status: image is up to date for a...
Pulling resolver ... done
Pulling node     ... digest: sha256:2ea9da862c215fd684...
Pulling node     ... status: image is up to date for a...
Pulling node     ... done
Pulling minio1   ... error

ERROR: for minio1  pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied
pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied
 (cluster.py:2827, logging_pulling_images)
2026-09-30 17:15:36 [ 536 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw7/.env', '--project-name', 'roottestlogfamilys3_gw7', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw7/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check)
2026-09-30 17:16:38 [ 536 ] DEBUG : Stderr:Pulling proxy2   ...  (cluster.py:123, run_and_check)
2026-09-30 17:16:38 [ 536 ] DEBUG : Stderr:Pulling proxy1   ...  (cluster.py:123, run_and_check)
2026-09-30 17:16:38 [ 536 ] DEBUG : Stderr:Pulling resolver ...  (cluster.py:123, run_and_check)
2026-09-30 17:16:38 [ 536 ] DEBUG : Stderr:Pulling minio1   ...  (cluster.py:123, run_and_check)
2026-09-30 17:16:38 [ 536 ] DEBUG : Stderr:Pulling node     ...  (cluster.py:123, run_and_check)
2026-09-30 17:16:38 [ 536 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check)
2026-09-30 17:16:38 [ 536 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check)
2026-09-30 17:16:38 [ 536 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check)
2026-09-30 17:16:38 [ 536 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check)
2026-09-30 17:16:38 [ 536 ] DEBUG : Stderr:Pulling proxy2   ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check)
2026-09-30 17:16:38 [ 536 ] DEBUG : Stderr:Pulling proxy2   ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check)
2026-09-30 17:16:38 [ 536 ] DEBUG : Stderr:Pulling proxy2   ... status: image is up to date for a... (cluster.py:123, run_and_check)
2026-09-30 17:16:38 [ 536 ] DEBUG : Stderr:Pulling proxy1   ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check)
2026-09-30 17:16:38 [ 536 ] DEBUG : Stderr:Pulling proxy2   ... done (cluster.py:123, run_and_check)
2026-09-30 17:16:38 [ 536 ] DEBUG : Stderr:Pulling proxy1   ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check)
2026-09-30 17:16:38 [ 536 ] DEBUG : Stderr:Pulling proxy1   ... status: image is up to date for a... (cluster.py:123, run_and_check)
2026-09-30 17:16:38 [ 536 ] DEBUG : Stderr:Pulling proxy1   ... done (cluster.py:123, run_and_check)
2026-09-30 17:16:38 [ 536 ] DEBUG : Stderr:Pulling node     ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check)
2026-09-30 17:16:38 [ 536 ] DEBUG : Stderr:Pulling node     ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check)
2026-09-30 17:16:38 [ 536 ] DEBUG : Stderr:Pulling node     ... status: image is up to date for a... (cluster.py:123, run_and_check)
2026-09-30 17:16:38 [ 536 ] DEBUG : Stderr:Pulling node     ... done (cluster.py:123, run_and_check)
2026-09-30 17:16:38 [ 536 ] DEBUG : Stderr:Pulling minio1   ... error (cluster.py:123, run_and_check)
2026-09-30 17:16:38 [ 536 ] DEBUG : Stderr: (cluster.py:123, run_and_check)
2026-09-30 17:16:38 [ 536 ] DEBUG : Stderr:ERROR: for minio1  pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check)
2026-09-30 17:16:38 [ 536 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check)
2026-09-30 17:16:38 [ 536 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check)
2026-09-30 17:16:38 [ 536 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw7/.env', '--project-name', 'roottestlogfamilys3_gw7', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw7/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2   ... 
Pulling proxy1   ... 
Pulling resolver ... 
Pulling minio1   ... 
Pulling node     ... 
Pulling resolver ... pulling from altinityinfra/python...
Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d...
Pulling resolver ... status: image is up to date for a...
Pulling resolver ... done
Pulling proxy2   ... pulling from altinityinfra/s3-proxy
Pulling proxy2   ... digest: sha256:2c143e57962bb1494a...
Pulling proxy2   ... status: image is up to date for a...
Pulling proxy1   ... pulling from altinityinfra/s3-proxy
Pulling proxy2   ... done
Pulling proxy1   ... digest: sha256:2c143e57962bb1494a...
Pulling proxy1   ... status: image is up to date for a...
Pulling proxy1   ... done
Pulling node     ... pulling from altinityinfra/integr...
Pulling node     ... digest: sha256:2ea9da862c215fd684...
Pulling node     ... status: image is up to date for a...
Pulling node     ... done
Pulling minio1   ... error

ERROR: for minio1  pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied
pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied
 (cluster.py:2827, logging_pulling_images)
2026-09-30 17:16:43 [ 536 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw7/.env', '--project-name', 'roottestlogfamilys3_gw7', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw7/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check)
2026-09-30 17:17:37 [ 536 ] DEBUG : Stderr:Pulling proxy2   ...  (cluster.py:123, run_and_check)
2026-09-30 17:17:37 [ 536 ] DEBUG : Stderr:Pulling proxy1   ...  (cluster.py:123, run_and_check)
2026-09-30 17:17:37 [ 536 ] DEBUG : Stderr:Pulling minio1   ...  (cluster.py:123, run_and_check)
2026-09-30 17:17:37 [ 536 ] DEBUG : Stderr:Pulling node     ...  (cluster.py:123, run_and_check)
2026-09-30 17:17:37 [ 536 ] DEBUG : Stderr:Pulling resolver ...  (cluster.py:123, run_and_check)
2026-09-30 17:17:37 [ 536 ] DEBUG : Stderr:Pulling node     ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check)
2026-09-30 17:17:37 [ 536 ] DEBUG : Stderr:Pulling proxy1   ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check)
2026-09-30 17:17:37 [ 536 ] DEBUG : Stderr:Pulling proxy2   ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check)
2026-09-30 17:17:37 [ 536 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check)
2026-09-30 17:17:37 [ 536 ] DEBUG : Stderr:Pulling node     ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check)
2026-09-30 17:17:37 [ 536 ] DEBUG : Stderr:Pulling node     ... status: image is up to date for a... (cluster.py:123, run_and_check)
2026-09-30 17:17:37 [ 536 ] DEBUG : Stderr:Pulling proxy1   ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check)
2026-09-30 17:17:37 [ 536 ] DEBUG : Stderr:Pulling proxy1   ... status: image is up to date for a... (cluster.py:123, run_and_check)
2026-09-30 17:17:37 [ 536 ] DEBUG : Stderr:Pulling node     ... done (cluster.py:123, run_and_check)
2026-09-30 17:17:37 [ 536 ] DEBUG : Stderr:Pulling proxy1   ... done (cluster.py:123, run_and_check)
2026-09-30 17:17:37 [ 536 ] DEBUG : Stderr:Pulling proxy2   ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check)
2026-09-30 17:17:37 [ 536 ] DEBUG : Stderr:Pulling proxy2   ... status: image is up to date for a... (cluster.py:123, run_and_check)
2026-09-30 17:17:37 [ 536 ] DEBUG : Stderr:Pulling proxy2   ... done (cluster.py:123, run_and_check)
2026-09-30 17:17:37 [ 536 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check)
2026-09-30 17:17:37 [ 536 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check)
2026-09-30 17:17:37 [ 536 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check)
2026-09-30 17:17:37 [ 536 ] DEBUG : Stderr:Pulling minio1   ... error (cluster.py:123, run_and_check)
2026-09-30 17:17:37 [ 536 ] DEBUG : Stderr: (cluster.py:123, run_and_check)
2026-09-30 17:17:37 [ 536 ] DEBUG : Stderr:ERROR: for minio1  pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check)
2026-09-30 17:17:37 [ 536 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check)
2026-09-30 17:17:37 [ 536 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check)
2026-09-30 17:17:37 [ 536 ] DEBUG : Failed to start cluster:  (cluster.py:3178, start)
2026-09-30 17:17:37 [ 536 ] DEBUG : Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw7/.env', '--project-name', 'roottestlogfamilys3_gw7', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw7/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2   ... 
Pulling proxy1   ... 
Pulling minio1   ... 
Pulling node     ... 
Pulling resolver ... 
Pulling node     ... pulling from altinityinfra/integr...
Pulling proxy1   ... pulling from altinityinfra/s3-proxy
Pulling proxy2   ... pulling from altinityinfra/s3-proxy
Pulling resolver ... pulling from altinityinfra/python...
Pulling node     ... digest: sha256:2ea9da862c215fd684...
Pulling node     ... status: image is up to date for a...
Pulling proxy1   ... digest: sha256:2c143e57962bb1494a...
Pulling proxy1   ... status: image is up to date for a...
Pulling node     ... done
Pulling proxy1   ... done
Pulling proxy2   ... digest: sha256:2c143e57962bb1494a...
Pulling proxy2   ... status: image is up to date for a...
Pulling proxy2   ... done
Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d...
Pulling resolver ... status: image is up to date for a...
Pulling resolver ... done
Pulling minio1   ... error

ERROR: for minio1  pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied
pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied
 (cluster.py:3179, start)
2026-09-30 17:17:37 [ 536 ] DEBUG : None (cluster.py:3180, start)
2026-09-30 17:17:37 [ 536 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3246, shutdown)
2026-09-30 17:17:37 [ 536 ] DEBUG : Cleanup called (cluster.py:876, cleanup)
2026-09-30 17:17:37 [ 536 ] DEBUG : Docker networks for project roottestlogfamilys3_gw7 are NETWORK ID   NAME      DRIVER    SCOPE
 (cluster.py:855, print_all_docker_pieces)
2026-09-30 17:17:37 [ 536 ] DEBUG : Docker containers for project roottestlogfamilys3_gw7 are CONTAINER ID   IMAGE     COMMAND   CREATED   STATUS    PORTS     NAMES
 (cluster.py:863, print_all_docker_pieces)
2026-09-30 17:17:37 [ 536 ] DEBUG : Docker volumes for project roottestlogfamilys3_gw7 are DRIVER    VOLUME NAME
 (cluster.py:871, print_all_docker_pieces)
2026-09-30 17:17:37 [ 536 ] DEBUG : Command:docker container list --all --filter name='^/roottestlogfamilys3_gw7_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check)
2026-09-30 17:17:37 [ 536 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup)
2026-09-30 17:17:37 [ 536 ] DEBUG : No running containers for project: roottestlogfamilys3_gw7 (cluster.py:904, cleanup)
2026-09-30 17:17:37 [ 536 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup)
2026-09-30 17:17:37 [ 536 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup)
2026-09-30 17:17:37 [ 536 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check)
2026-09-30 17:17:37 [ 536 ] DEBUG : Stdout:6 (cluster.py:121, run_and_check)
2026-09-30 17:17:37 [ 536 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3246, shutdown)
2026-09-30 17:17:37 [ 536 ] DEBUG : Cleanup called (cluster.py:876, cleanup)
2026-09-30 17:17:37 [ 536 ] DEBUG : Docker networks for project roottestlogfamilys3_gw7 are NETWORK ID   NAME      DRIVER    SCOPE
 (cluster.py:855, print_all_docker_pieces)
2026-09-30 17:17:37 [ 536 ] DEBUG : Docker containers for project roottestlogfamilys3_gw7 are CONTAINER ID   IMAGE     COMMAND   CREATED   STATUS    PORTS     NAMES
 (cluster.py:863, print_all_docker_pieces)
2026-09-30 17:17:37 [ 536 ] DEBUG : Docker volumes for project roottestlogfamilys3_gw7 are DRIVER    VOLUME NAME
 (cluster.py:871, print_all_docker_pieces)
2026-09-30 17:17:37 [ 536 ] DEBUG : Command:docker container list --all --filter name='^/roottestlogfamilys3_gw7_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check)
2026-09-30 17:17:37 [ 536 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup)
2026-09-30 17:17:37 [ 536 ] DEBUG : No running containers for project: roottestlogfamilys3_gw7 (cluster.py:904, cleanup)
2026-09-30 17:17:37 [ 536 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup)
2026-09-30 17:17:37 [ 536 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup)
2026-09-30 17:17:37 [ 536 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check)
2026-09-30 17:17:37 [ 536 ] DEBUG : Stdout:6 (cluster.py:121, run_and_check)
_______________ ERROR at setup of test_log_family_s3[StripeLog] ________________
[gw7] linux -- Python 3.10.12 /usr/bin/python3

    @pytest.fixture(scope="module")
    def cluster():
        try:
            cluster = ClickHouseCluster(__file__)
            cluster.add_instance(
                "node",
                main_configs=["configs/storage_configuration.xml", "configs/ssl.xml"],
                with_minio=True,
            )
            logging.info("Starting cluster...")
>           cluster.start()

test_log_family_s3/test.py:18: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
helpers/cluster.py:2831: in start
    retry(log_function=logging_pulling_images)(run_and_check)(
helpers/retry_decorator.py:28: in wrapper
    raise e
helpers/retry_decorator.py:19: in wrapper
    func(*args, **kwargs)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw7/.env', '--project-name', 'roottestlogfamilys3_gw7', '--file', ...]
env = None, shell = False, stdout = -1, stderr = -1, timeout = 900
nothrow = False, detach = False

    def run_and_check(
        args,
        env=None,
        shell=False,
        stdout=subprocess.PIPE,
        stderr=subprocess.PIPE,
        timeout=300,
        nothrow=False,
        detach=False,
    ):
        if detach:
            subprocess.Popen(
                args,
                stdout=subprocess.DEVNULL,
                stderr=subprocess.DEVNULL,
                env=env,
                shell=shell,
            )
            return
    
        logging.debug(f"Command:{args}")
        res = subprocess.run(
            args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout
        )
        out = res.stdout.decode("utf-8", "ignore")
        err = res.stderr.decode("utf-8", "ignore")
        # check_call(...) from subprocess does not print stderr, so we do it manually
        for outline in out.splitlines():
            logging.debug(f"Stdout:{outline}")
        for errline in err.splitlines():
            logging.debug(f"Stderr:{errline}")
        if res.returncode != 0:
            logging.debug(f"Exitcode:{res.returncode}")
            if env:
                logging.debug(f"Env:{env}")
            if not nothrow:
>               raise Exception(
                    f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}"
                )
E               Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw7/.env', '--project-name', 'roottestlogfamilys3_gw7', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw7/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2   ... 
E               Pulling proxy1   ... 
E               Pulling minio1   ... 
E               Pulling node     ... 
E               Pulling resolver ... 
E               Pulling node     ... pulling from altinityinfra/integr...
E               Pulling proxy1   ... pulling from altinityinfra/s3-proxy
E               Pulling proxy2   ... pulling from altinityinfra/s3-proxy
E               Pulling resolver ... pulling from altinityinfra/python...
E               Pulling node     ... digest: sha256:2ea9da862c215fd684...
E               Pulling node     ... status: image is up to date for a...
E               Pulling proxy1   ... digest: sha256:2c143e57962bb1494a...
E               Pulling proxy1   ... status: image is up to date for a...
E               Pulling node     ... done
E               Pulling proxy1   ... done
E               Pulling proxy2   ... digest: sha256:2c143e57962bb1494a...
E               Pulling proxy2   ... status: image is up to date for a...
E               Pulling proxy2   ... done
E               Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d...
E               Pulling resolver ... status: image is up to date for a...
E               Pulling resolver ... done
E               Pulling minio1   ... error
E               
E               ERROR: for minio1  pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied
E               pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied

helpers/cluster.py:129: Exception
________________ ERROR at setup of test_log_family_s3[TinyLog] _________________
[gw7] linux -- Python 3.10.12 /usr/bin/python3

    @pytest.fixture(scope="module")
    def cluster():
        try:
            cluster = ClickHouseCluster(__file__)
            cluster.add_instance(
                "node",
                main_configs=["configs/storage_configuration.xml", "configs/ssl.xml"],
                with_minio=True,
            )
            logging.info("Starting cluster...")
>           cluster.start()

test_log_family_s3/test.py:18: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
helpers/cluster.py:2831: in start
    retry(log_function=logging_pulling_images)(run_and_check)(
helpers/retry_decorator.py:28: in wrapper
    raise e
helpers/retry_decorator.py:19: in wrapper
    func(*args, **kwargs)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw7/.env', '--project-name', 'roottestlogfamilys3_gw7', '--file', ...]
env = None, shell = False, stdout = -1, stderr = -1, timeout = 900
nothrow = False, detach = False

    def run_and_check(
        args,
        env=None,
        shell=False,
        stdout=subprocess.PIPE,
        stderr=subprocess.PIPE,
        timeout=300,
        nothrow=False,
        detach=False,
    ):
        if detach:
            subprocess.Popen(
                args,
                stdout=subprocess.DEVNULL,
                stderr=subprocess.DEVNULL,
                env=env,
                shell=shell,
            )
            return
    
        logging.debug(f"Command:{args}")
        res = subprocess.run(
            args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout
        )
        out = res.stdout.decode("utf-8", "ignore")
        err = res.stderr.decode("utf-8", "ignore")
        # check_call(...) from subprocess does not print stderr, so we do it manually
        for outline in out.splitlines():
            logging.debug(f"Stdout:{outline}")
        for errline in err.splitlines():
            logging.debug(f"Stderr:{errline}")
        if res.returncode != 0:
            logging.debug(f"Exitcode:{res.returncode}")
            if env:
                logging.debug(f"Env:{env}")
            if not nothrow:
>               raise Exception(
                    f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}"
                )
E               Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw7/.env', '--project-name', 'roottestlogfamilys3_gw7', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw7/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2   ... 
E               Pulling proxy1   ... 
E               Pulling minio1   ... 
E               Pulling node     ... 
E               Pulling resolver ... 
E               Pulling node     ... pulling from altinityinfra/integr...
E               Pulling proxy1   ... pulling from altinityinfra/s3-proxy
E               Pulling proxy2   ... pulling from altinityinfra/s3-proxy
E               Pulling resolver ... pulling from altinityinfra/python...
E               Pulling node     ... digest: sha256:2ea9da862c215fd684...
E               Pulling node     ... status: image is up to date for a...
E               Pulling proxy1   ... digest: sha256:2c143e57962bb1494a...
E               Pulling proxy1   ... status: image is up to date for a...
E               Pulling node     ... done
E               Pulling proxy1   ... done
E               Pulling proxy2   ... digest: sha256:2c143e57962bb1494a...
E               Pulling proxy2   ... status: image is up to date for a...
E               Pulling proxy2   ... done
E               Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d...
E               Pulling resolver ... status: image is up to date for a...
E               Pulling resolver ... done
E               Pulling minio1   ... error
E               
E               ERROR: for minio1  pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied
E               pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied

helpers/cluster.py:129: Exception
__________________ ERROR at setup of test_stripe_log_truncate __________________
[gw7] linux -- Python 3.10.12 /usr/bin/python3

    @pytest.fixture(scope="module")
    def cluster():
        try:
            cluster = ClickHouseCluster(__file__)
            cluster.add_instance(
                "node",
                main_configs=["configs/storage_configuration.xml", "configs/ssl.xml"],
                with_minio=True,
            )
            logging.info("Starting cluster...")
>           cluster.start()

test_log_family_s3/test.py:18: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
helpers/cluster.py:2831: in start
    retry(log_function=logging_pulling_images)(run_and_check)(
helpers/retry_decorator.py:28: in wrapper
    raise e
helpers/retry_decorator.py:19: in wrapper
    func(*args, **kwargs)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw7/.env', '--project-name', 'roottestlogfamilys3_gw7', '--file', ...]
env = None, shell = False, stdout = -1, stderr = -1, timeout = 900
nothrow = False, detach = False

    def run_and_check(
        args,
        env=None,
        shell=False,
        stdout=subprocess.PIPE,
        stderr=subprocess.PIPE,
        timeout=300,
        nothrow=False,
        detach=False,
    ):
        if detach:
            subprocess.Popen(
                args,
                stdout=subprocess.DEVNULL,
                stderr=subprocess.DEVNULL,
                env=env,
                shell=shell,
            )
            return
    
        logging.debug(f"Command:{args}")
        res = subprocess.run(
            args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout
        )
        out = res.stdout.decode("utf-8", "ignore")
        err = res.stderr.decode("utf-8", "ignore")
        # check_call(...) from subprocess does not print stderr, so we do it manually
        for outline in out.splitlines():
            logging.debug(f"Stdout:{outline}")
        for errline in err.splitlines():
            logging.debug(f"Stderr:{errline}")
        if res.returncode != 0:
            logging.debug(f"Exitcode:{res.returncode}")
            if env:
                logging.debug(f"Env:{env}")
            if not nothrow:
>               raise Exception(
                    f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}"
                )
E               Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw7/.env', '--project-name', 'roottestlogfamilys3_gw7', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw7/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2   ... 
E               Pulling proxy1   ... 
E               Pulling minio1   ... 
E               Pulling node     ... 
E               Pulling resolver ... 
E               Pulling node     ... pulling from altinityinfra/integr...
E               Pulling proxy1   ... pulling from altinityinfra/s3-proxy
E               Pulling proxy2   ... pulling from altinityinfra/s3-proxy
E               Pulling resolver ... pulling from altinityinfra/python...
E               Pulling node     ... digest: sha256:2ea9da862c215fd684...
E               Pulling node     ... status: image is up to date for a...
E               Pulling proxy1   ... digest: sha256:2c143e57962bb1494a...
E               Pulling proxy1   ... status: image is up to date for a...
E               Pulling node     ... done
E               Pulling proxy1   ... done
E               Pulling proxy2   ... digest: sha256:2c143e57962bb1494a...
E               Pulling proxy2   ... status: image is up to date for a...
E               Pulling proxy2   ... done
E               Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d...
E               Pulling resolver ... status: image is up to date for a...
E               Pulling resolver ... done
E               Pulling minio1   ... error
E               
E               ERROR: for minio1  pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied
E               pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied

helpers/cluster.py:129: Exception
________________________ ERROR at setup of test_join_s3 ________________________
[gw2] linux -- Python 3.10.12 /usr/bin/python3

    @pytest.fixture(scope="module")
    def cluster():
        try:
            cluster = ClickHouseCluster(__file__)
            cluster.add_instance(
                "node",
                main_configs=["configs/minio.xml", "configs/ssl.xml"],
                with_minio=True,
                stay_alive=True,
            )
            logging.info("Starting cluster...")
>           cluster.start()

test_join_set_family_s3/test.py:19: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
helpers/cluster.py:2831: in start
    retry(log_function=logging_pulling_images)(run_and_check)(
helpers/retry_decorator.py:28: in wrapper
    raise e
helpers/retry_decorator.py:19: in wrapper
    func(*args, **kwargs)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/.env', '--project-name', 'roottestjoinsetfamilys3_gw2', '--file', ...]
env = None, shell = False, stdout = -1, stderr = -1, timeout = 900
nothrow = False, detach = False

    def run_and_check(
        args,
        env=None,
        shell=False,
        stdout=subprocess.PIPE,
        stderr=subprocess.PIPE,
        timeout=300,
        nothrow=False,
        detach=False,
    ):
        if detach:
            subprocess.Popen(
                args,
                stdout=subprocess.DEVNULL,
                stderr=subprocess.DEVNULL,
                env=env,
                shell=shell,
            )
            return
    
        logging.debug(f"Command:{args}")
        res = subprocess.run(
            args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout
        )
        out = res.stdout.decode("utf-8", "ignore")
        err = res.stderr.decode("utf-8", "ignore")
        # check_call(...) from subprocess does not print stderr, so we do it manually
        for outline in out.splitlines():
            logging.debug(f"Stdout:{outline}")
        for errline in err.splitlines():
            logging.debug(f"Stderr:{errline}")
        if res.returncode != 0:
            logging.debug(f"Exitcode:{res.returncode}")
            if env:
                logging.debug(f"Env:{env}")
            if not nothrow:
>               raise Exception(
                    f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}"
                )
E               Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/.env', '--project-name', 'roottestjoinsetfamilys3_gw2', '--file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2   ... 
E               Pulling proxy1   ... 
E               Pulling resolver ... 
E               Pulling minio1   ... 
E               Pulling node     ... 
E               Pulling node     ... pulling from altinityinfra/integr...
E               Pulling resolver ... pulling from altinityinfra/python...
E               Pulling proxy1   ... pulling from altinityinfra/s3-proxy
E               Pulling proxy2   ... pulling from altinityinfra/s3-proxy
E               Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d...
E               Pulling resolver ... status: image is up to date for a...
E               Pulling proxy1   ... digest: sha256:2c143e57962bb1494a...
E               Pulling proxy1   ... status: image is up to date for a...
E               Pulling resolver ... done
E               Pulling proxy1   ... done
E               Pulling proxy2   ... digest: sha256:2c143e57962bb1494a...
E               Pulling proxy2   ... status: image is up to date for a...
E               Pulling node     ... digest: sha256:2ea9da862c215fd684...
E               Pulling node     ... status: image is up to date for a...
E               Pulling proxy2   ... done
E               Pulling node     ... done
E               Pulling minio1   ... error
E               
E               ERROR: for minio1  pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied
E               pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied

helpers/cluster.py:129: Exception
---------------------------- Captured stdout setup -----------------------------
Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml
---------------------------- Captured stderr setup -----------------------------
Traceback (most recent call last):
  File "/ClickHouse/tests/integration/helpers/cluster.py", line 2831, in start
    retry(log_function=logging_pulling_images)(run_and_check)(
  File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 28, in wrapper
    raise e
  File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 19, in wrapper
    func(*args, **kwargs)
  File "/ClickHouse/tests/integration/helpers/cluster.py", line 129, in run_and_check
    raise Exception(
Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/.env', '--project-name', 'roottestjoinsetfamilys3_gw2', '--file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2   ... 
Pulling proxy1   ... 
Pulling resolver ... 
Pulling minio1   ... 
Pulling node     ... 
Pulling node     ... pulling from altinityinfra/integr...
Pulling resolver ... pulling from altinityinfra/python...
Pulling proxy1   ... pulling from altinityinfra/s3-proxy
Pulling proxy2   ... pulling from altinityinfra/s3-proxy
Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d...
Pulling resolver ... status: image is up to date for a...
Pulling proxy1   ... digest: sha256:2c143e57962bb1494a...
Pulling proxy1   ... status: image is up to date for a...
Pulling resolver ... done
Pulling proxy1   ... done
Pulling proxy2   ... digest: sha256:2c143e57962bb1494a...
Pulling proxy2   ... status: image is up to date for a...
Pulling node     ... digest: sha256:2ea9da862c215fd684...
Pulling node     ... status: image is up to date for a...
Pulling proxy2   ... done
Pulling node     ... done
Pulling minio1   ... error

ERROR: for minio1  pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied
pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied

------------------------------ Captured log setup ------------------------------
2026-09-30 17:13:32 [ 476 ] DEBUG : ENV                  DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 (cluster.py:446, __init__)
2026-09-30 17:13:32 [ 476 ] DEBUG : ENV         CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse (cluster.py:446, __init__)
2026-09-30 17:13:32 [ 476 ] DEBUG : ENV                             MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 (cluster.py:446, __init__)
2026-09-30 17:13:32 [ 476 ] DEBUG : ENV                        JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true (cluster.py:446, __init__)
2026-09-30 17:13:32 [ 476 ] DEBUG : ENV                             TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 (cluster.py:446, __init__)
2026-09-30 17:13:32 [ 476 ] DEBUG : ENV                                 HOSTNAME 76c92d12e6d5 (cluster.py:446, __init__)
2026-09-30 17:13:32 [ 476 ] DEBUG : ENV                                    SHLVL 0 (cluster.py:446, __init__)
2026-09-30 17:13:32 [ 476 ] DEBUG : ENV                                     HOME /root (cluster.py:446, __init__)
2026-09-30 17:13:32 [ 476 ] DEBUG : ENV                                   OLDPWD / (cluster.py:446, __init__)
2026-09-30 17:13:32 [ 476 ] DEBUG : ENV                        DOCKER_HELPER_TAG 2cffe1eae894 (cluster.py:446, __init__)
2026-09-30 17:13:32 [ 476 ] DEBUG : ENV                         PYTHONUNBUFFERED 1 (cluster.py:446, __init__)
2026-09-30 17:13:32 [ 476 ] DEBUG : ENV                 DOCKER_PYTHON_BOTTLE_TAG caad4729259e (cluster.py:446, __init__)
2026-09-30 17:13:32 [ 476 ] DEBUG : ENV                            UBSAN_OPTIONS print_stacktrace=1 (cluster.py:446, __init__)
2026-09-30 17:13:32 [ 476 ] DEBUG : ENV                           PYTEST_ADDOPTS --dist=loadfile -n 10  -rfEps --run-id=0 --color=no --durations=0 'test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node0-True]' 'test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node1-False]' test_failed_mutations/test.py::test_exponential_backoff_with_replicated_tree 'test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[False]' 'test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[True]' test_fetch_partition_with_outdated_parts/test.py::test_fetch_partition_with_outdated_parts test_file_schema_inference_cache/test.py::test 'test_filesystem_cache/test.py::test_caches_with_the_same_configuration[node]' 'test_filesystem_cache/test.py::test_caches_with_the_same_configuration_2[node_caches_with_same_path]' test_filesystem_cache/test.py::test_custom_cached_disk test_filesystem_cache/test.py::test_force_filesystem_cache_on_merges test_filesystem_cache/test.py::test_keep_up_size_ratio 'test_filesystem_cache/test.py::test_parallel_cache_loading_on_startup[node]' test_filesystem_cache/test.py::test_system_sync_filesystem_cache test_grant_and_revoke/test_without_table_engine_grant.py::test_table_engine_and_source_grant test_http_native/test.py::test_http_native_returns_timezone test_intersecting_parts/test.py::test_intersect_parts_when_restart test_jbod_balancer/test.py::test_jbod_balanced_merge test_jbod_balancer/test.py::test_replicated_balanced_merge_fetch test_join_set_family_s3/test.py::test_join_s3 test_join_set_family_s3/test.py::test_set_s3 test_kafka_bad_messages/test.py::test_bad_messages_parsing_exception test_kafka_bad_messages/test.py::test_bad_messages_parsing_stream test_kafka_bad_messages/test.py::test_bad_messages_to_mv test_keeper_back_to_back/test.py::test_concurrent_watches test_keeper_back_to_back/test.py::test_end_of_session test_keeper_back_to_back/test.py::test_end_of_watches_session test_keeper_back_to_back/test.py::test_multitransactions test_keeper_back_to_back/test.py::test_random_requests test_keeper_back_to_back/test.py::test_sequential_nodes test_keeper_back_to_back/test.py::test_simple_commands test_keeper_back_to_back/test.py::test_stats test_keeper_back_to_back/test.py::test_watchers test_keeper_client/test.py::test_base_commands test_keeper_client/test.py::test_big_family test_keeper_client/test.py::test_delete_stale_backups test_keeper_client/test.py::test_find_super_nodes test_keeper_client/test.py::test_four_letter_word_commands test_keeper_client/test.py::test_get_all_children_number test_keeper_client/test.py::test_quoted_argument_parsing test_keeper_client/test.py::test_rm_with_version test_keeper_client/test.py::test_rm_without_version test_keeper_client/test.py::test_set_with_version test_keeper_client/test.py::test_set_without_version test_keeper_force_recovery_single_node/test.py::test_cluster_recovery test_keeper_four_word_command/test.py::test_cmd_clrs test_keeper_four_word_command/test.py::test_cmd_conf test_keeper_four_word_command/test.py::test_cmd_cons test_keeper_four_word_command/test.py::test_cmd_crst test_keeper_four_word_command/test.py::test_cmd_csnp test_keeper_four_word_command/test.py::test_cmd_dump test_keeper_four_word_command/test.py::test_cmd_isro test_keeper_four_word_command/test.py::test_cmd_lgif test_keeper_four_word_command/test.py::test_cmd_mntr test_keeper_four_word_command/test.py::test_cmd_rqld test_keeper_four_word_command/test.py::test_cmd_ruok test_keeper_four_word_command/test.py::test_cmd_srst test_keeper_four_word_command/test.py::test_cmd_srvr test_keeper_four_word_command/test.py::test_cmd_stat test_keeper_four_word_command/test.py::test_cmd_wchc test_keeper_four_word_command/test.py::test_cmd_wchp test_keeper_four_word_command/test.py::test_cmd_wchs test_keeper_four_word_command/test.py::test_cmd_ydld test_keeper_four_word_command/test_allow_list.py::test_allow_list test_keeper_mntr_pressure/test.py::test_aggressive_mntr test_keeper_nodes_move/test.py::test_node_move test_keeper_reconfig_replace_leader_in_one_command/test.py::test_reconfig_replace_leader_in_one_command test_keeper_session/test.py::test_session_close_shutdown test_keeper_session/test.py::test_session_timeout test_keeper_snapshot_on_exit/test.py::test_snapshot_on_exit 'test_log_family_s3/test.py::test_log_family_s3[Log]' 'test_log_family_s3/test.py::test_log_family_s3[StripeLog]' 'test_log_family_s3/test.py::test_log_family_s3[TinyLog]' test_log_family_s3/test.py::test_stripe_log_truncate test_logs_level/test.py::test_check_client_logs_level test_mask_sensitive_info/test.py::test_backup_table test_mask_sensitive_info/test.py::test_backup_to_s3 test_mask_sensitive_info/test.py::test_create_alter_user test_mask_sensitive_info/test.py::test_create_database test_mask_sensitive_info/test.py::test_create_dictionary test_mask_sensitive_info/test.py::test_create_table test_mask_sensitive_info/test.py::test_encryption_functions test_mask_sensitive_info/test.py::test_on_cluster test_mask_sensitive_info/test.py::test_table_function_ways_to_call test_mask_sensitive_info/test.py::test_table_functions test_materialized_view_restart_server/test.py::test_materialized_view_with_subquery test_memory_limit_observer/test.py::test_memory_usage_doesnt_include_page_cache_size test_memory_limit_observer/test.py::test_observe_memory_limit test_merge_table_over_distributed/test.py::test_filtering test_merge_table_over_distributed/test.py::test_global_in test_merge_table_over_distributed/test.py::test_select_table_name_from_merge_over_distributed test_modify_engine_on_restart/test_unusual_path.py::test_modify_engine_on_restart_with_unusual_path test_modify_engine_on_restart/test_zk_path_exists.py::test_modify_engine_fails_if_zk_path_exists test_multi_access_storage_role_management/test.py::test_quotas test_multi_access_storage_role_management/test.py::test_role_from_different_storages test_multi_access_storage_role_management/test.py::test_roles test_multi_access_storage_role_management/test.py::test_settings_profiles test_multi_access_storage_role_management/test.py::test_users test_mutations_with_merge_tree/test.py::test_mutations_with_merge_background_task test_mutations_with_merge_tree/test.py::test_mutations_with_truncate_table  -vvv (cluster.py:446, __init__)
2026-09-30 17:13:32 [ 476 ] DEBUG : ENV    CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge (cluster.py:446, __init__)
2026-09-30 17:13:32 [ 476 ] DEBUG : ENV                     COMPOSE_HTTP_TIMEOUT 600 (cluster.py:446, __init__)
2026-09-30 17:13:32 [ 476 ] DEBUG : ENV              DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 (cluster.py:446, __init__)
2026-09-30 17:13:32 [ 476 ] DEBUG : ENV                 DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d (cluster.py:446, __init__)
2026-09-30 17:13:32 [ 476 ] DEBUG : ENV         CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse (cluster.py:446, __init__)
2026-09-30 17:13:32 [ 476 ] DEBUG : ENV               DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 (cluster.py:446, __init__)
2026-09-30 17:13:32 [ 476 ] DEBUG : ENV                                     PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin (cluster.py:446, __init__)
2026-09-30 17:13:32 [ 476 ] DEBUG : ENV             DOCKER_KERBERIZED_HADOOP_TAG latest (cluster.py:446, __init__)
2026-09-30 17:13:32 [ 476 ] DEBUG : ENV                           DOCKER_CHANNEL stable (cluster.py:446, __init__)
2026-09-30 17:13:32 [ 476 ] DEBUG : ENV                    DOCKER_CLIENT_TIMEOUT 300 (cluster.py:446, __init__)
2026-09-30 17:13:32 [ 476 ] DEBUG : ENV        DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 (cluster.py:446, __init__)
2026-09-30 17:13:32 [ 476 ] DEBUG : ENV                     DOCKER_NGINX_DAV_TAG b55ac9cd7519 (cluster.py:446, __init__)
2026-09-30 17:13:32 [ 476 ] DEBUG : ENV           DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e (cluster.py:446, __init__)
2026-09-30 17:13:32 [ 476 ] DEBUG : ENV                                      PWD /ClickHouse/tests/integration (cluster.py:446, __init__)
2026-09-30 17:13:32 [ 476 ] DEBUG : ENV             DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 (cluster.py:446, __init__)
2026-09-30 17:13:32 [ 476 ] DEBUG : ENV       CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge (cluster.py:446, __init__)
2026-09-30 17:13:32 [ 476 ] DEBUG : ENV         CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config (cluster.py:446, __init__)
2026-09-30 17:13:32 [ 476 ] DEBUG : ENV                                       TZ Etc/UTC (cluster.py:446, __init__)
2026-09-30 17:13:32 [ 476 ] DEBUG : ENV                                JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java (cluster.py:446, __init__)
2026-09-30 17:13:32 [ 476 ] DEBUG : ENV                          DOCKER_BASE_TAG b74d853ebe76 (cluster.py:446, __init__)
2026-09-30 17:13:32 [ 476 ] DEBUG : ENV                               SPARK_HOME /spark-3.3.2-bin-hadoop3 (cluster.py:446, __init__)
2026-09-30 17:13:32 [ 476 ] DEBUG : ENV                                 LC_CTYPE C.UTF-8 (cluster.py:446, __init__)
2026-09-30 17:13:32 [ 476 ] DEBUG : ENV                 INTEGRATION_TESTS_RUN_ID 0 (cluster.py:446, __init__)
2026-09-30 17:13:32 [ 476 ] DEBUG : ENV                        WORKER_FREE_PORTS 30100 30101 30102 30103 30104 30105 30106 30107 30108 30109 30110 30111 30112 30113 30114 30115 30116 30117 30118 30119 30120 30121 30122 30123 30124 30125 30126 30127 30128 30129 30130 30131 30132 30133 30134 30135 30136 30137 30138 30139 30140 30141 30142 30143 30144 30145 30146 30147 30148 30149 (cluster.py:446, __init__)
2026-09-30 17:13:32 [ 476 ] DEBUG : ENV                  PYTEST_XDIST_TESTRUNUID 0d0c4a1eede545eebd7db10a4b10eec0 (cluster.py:446, __init__)
2026-09-30 17:13:32 [ 476 ] DEBUG : ENV                      PYTEST_XDIST_WORKER gw2 (cluster.py:446, __init__)
2026-09-30 17:13:32 [ 476 ] DEBUG : ENV                PYTEST_XDIST_WORKER_COUNT 10 (cluster.py:446, __init__)
2026-09-30 17:13:32 [ 476 ] DEBUG : ENV                      PYTEST_CURRENT_TEST test_join_set_family_s3/test.py::test_join_s3 (setup) (cluster.py:446, __init__)
2026-09-30 17:13:32 [ 476 ] DEBUG : CLUSTER INIT base_config_dir:/clickhouse-config (cluster.py:766, __init__)
2026-09-30 17:13:32 [ 476 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1787, add_instance)
2026-09-30 17:13:32 [ 476 ] DEBUG : Cluster name: project_name:roottestjoinsetfamilys3_gw2. Added instance name:node tag:b74d853ebe76 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/.env', '--project-name', 'roottestjoinsetfamilys3_gw2', '--file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:2081, add_instance)
2026-09-30 17:13:32 [ 476 ] INFO : Starting cluster... (test.py:18, cluster)
2026-09-30 17:13:32 [ 476 ] INFO : Running tests in /ClickHouse/tests/integration/test_join_set_family_s3/test.py (cluster.py:2790, start)
2026-09-30 17:13:32 [ 476 ] DEBUG : Cluster start called. is_up=False (cluster.py:2797, start)
2026-09-30 17:13:32 [ 476 ] DEBUG : Docker networks for project roottestjoinsetfamilys3_gw2 are NETWORK ID   NAME      DRIVER    SCOPE
 (cluster.py:855, print_all_docker_pieces)
2026-09-30 17:13:32 [ 476 ] DEBUG : Docker containers for project roottestjoinsetfamilys3_gw2 are CONTAINER ID   IMAGE     COMMAND   CREATED   STATUS    PORTS     NAMES
 (cluster.py:863, print_all_docker_pieces)
2026-09-30 17:13:32 [ 476 ] DEBUG : Docker volumes for project roottestjoinsetfamilys3_gw2 are DRIVER    VOLUME NAME
 (cluster.py:871, print_all_docker_pieces)
2026-09-30 17:13:32 [ 476 ] DEBUG : Cleanup called (cluster.py:876, cleanup)
2026-09-30 17:13:32 [ 476 ] DEBUG : Docker networks for project roottestjoinsetfamilys3_gw2 are NETWORK ID   NAME      DRIVER    SCOPE
 (cluster.py:855, print_all_docker_pieces)
2026-09-30 17:13:32 [ 476 ] DEBUG : Docker containers for project roottestjoinsetfamilys3_gw2 are CONTAINER ID   IMAGE     COMMAND   CREATED   STATUS    PORTS     NAMES
 (cluster.py:863, print_all_docker_pieces)
2026-09-30 17:13:32 [ 476 ] DEBUG : Docker volumes for project roottestjoinsetfamilys3_gw2 are DRIVER    VOLUME NAME
 (cluster.py:871, print_all_docker_pieces)
2026-09-30 17:13:32 [ 476 ] DEBUG : Command:docker container list --all --filter name='^/roottestjoinsetfamilys3_gw2_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check)
2026-09-30 17:13:32 [ 476 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup)
2026-09-30 17:13:32 [ 476 ] DEBUG : No running containers for project: roottestjoinsetfamilys3_gw2 (cluster.py:904, cleanup)
2026-09-30 17:13:32 [ 476 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup)
2026-09-30 17:13:32 [ 476 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup)
2026-09-30 17:13:32 [ 476 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check)
2026-09-30 17:13:32 [ 476 ] DEBUG : Stdout:4 (cluster.py:121, run_and_check)
2026-09-30 17:13:32 [ 476 ] DEBUG : Setup directory for instance: node (cluster.py:2810, start)
2026-09-30 17:13:32 [ 476 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4538, create_dir)
2026-09-30 17:13:32 [ 476 ] DEBUG : Create directory for common tests configuration (cluster.py:4543, create_dir)
2026-09-30 17:13:32 [ 476 ] DEBUG : Copy common configuration from helpers (cluster.py:4563, create_dir)
2026-09-30 17:13:32 [ 476 ] DEBUG : Generate and write macros file (cluster.py:4606, create_dir)
2026-09-30 17:13:32 [ 476 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_join_set_family_s3/configs/minio.xml', '/ClickHouse/tests/integration/test_join_set_family_s3/configs/ssl.xml'] to /ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/node/configs/config.d (cluster.py:4636, create_dir)
2026-09-30 17:13:32 [ 476 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/node/database (cluster.py:4653, create_dir)
2026-09-30 17:13:32 [ 476 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/node/logs (cluster.py:4664, create_dir)
2026-09-30 17:13:32 [ 476 ] DEBUG : Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" (cluster.py:4750, create_dir)
2026-09-30 17:13:32 [ 476 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/.env (cluster.py:86, _create_env_file)
2026-09-30 17:13:32 [ 476 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file)
2026-09-30 17:13:32 [ 476 ] DEBUG : No config file found (config.py:28, find_config_file)
2026-09-30 17:13:32 [ 476 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file)
2026-09-30 17:13:32 [ 476 ] DEBUG : No config file found (config.py:28, find_config_file)
2026-09-30 17:13:32 [ 476 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 825 (connectionpool.py:547, _make_request)
2026-09-30 17:13:32 [ 476 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/.env', '--project-name', 'roottestjoinsetfamilys3_gw2', '--file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check)
2026-09-30 17:14:27 [ 476 ] DEBUG : Stderr:Pulling proxy1   ...  (cluster.py:123, run_and_check)
2026-09-30 17:14:27 [ 476 ] DEBUG : Stderr:Pulling proxy2   ...  (cluster.py:123, run_and_check)
2026-09-30 17:14:27 [ 476 ] DEBUG : Stderr:Pulling resolver ...  (cluster.py:123, run_and_check)
2026-09-30 17:14:27 [ 476 ] DEBUG : Stderr:Pulling minio1   ...  (cluster.py:123, run_and_check)
2026-09-30 17:14:27 [ 476 ] DEBUG : Stderr:Pulling node     ...  (cluster.py:123, run_and_check)
2026-09-30 17:14:27 [ 476 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check)
2026-09-30 17:14:27 [ 476 ] DEBUG : Stderr:Pulling proxy2   ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check)
2026-09-30 17:14:27 [ 476 ] DEBUG : Stderr:Pulling proxy1   ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check)
2026-09-30 17:14:27 [ 476 ] DEBUG : Stderr:Pulling node     ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check)
2026-09-30 17:14:27 [ 476 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check)
2026-09-30 17:14:27 [ 476 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check)
2026-09-30 17:14:27 [ 476 ] DEBUG : Stderr:Pulling proxy2   ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check)
2026-09-30 17:14:27 [ 476 ] DEBUG : Stderr:Pulling proxy2   ... status: image is up to date for a... (cluster.py:123, run_and_check)
2026-09-30 17:14:27 [ 476 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check)
2026-09-30 17:14:27 [ 476 ] DEBUG : Stderr:Pulling proxy2   ... done (cluster.py:123, run_and_check)
2026-09-30 17:14:27 [ 476 ] DEBUG : Stderr:Pulling proxy1   ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check)
2026-09-30 17:14:27 [ 476 ] DEBUG : Stderr:Pulling proxy1   ... status: image is up to date for a... (cluster.py:123, run_and_check)
2026-09-30 17:14:27 [ 476 ] DEBUG : Stderr:Pulling proxy1   ... done (cluster.py:123, run_and_check)
2026-09-30 17:14:27 [ 476 ] DEBUG : Stderr:Pulling node     ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check)
2026-09-30 17:14:27 [ 476 ] DEBUG : Stderr:Pulling node     ... status: image is up to date for a... (cluster.py:123, run_and_check)
2026-09-30 17:14:27 [ 476 ] DEBUG : Stderr:Pulling node     ... done (cluster.py:123, run_and_check)
2026-09-30 17:14:27 [ 476 ] DEBUG : Stderr:Pulling minio1   ... error (cluster.py:123, run_and_check)
2026-09-30 17:14:27 [ 476 ] DEBUG : Stderr: (cluster.py:123, run_and_check)
2026-09-30 17:14:27 [ 476 ] DEBUG : Stderr:ERROR: for minio1  pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check)
2026-09-30 17:14:27 [ 476 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check)
2026-09-30 17:14:27 [ 476 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check)
2026-09-30 17:14:27 [ 476 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/.env', '--project-name', 'roottestjoinsetfamilys3_gw2', '--file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1   ... 
Pulling proxy2   ... 
Pulling resolver ... 
Pulling minio1   ... 
Pulling node     ... 
Pulling resolver ... pulling from altinityinfra/python...
Pulling proxy2   ... pulling from altinityinfra/s3-proxy
Pulling proxy1   ... pulling from altinityinfra/s3-proxy
Pulling node     ... pulling from altinityinfra/integr...
Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d...
Pulling resolver ... status: image is up to date for a...
Pulling proxy2   ... digest: sha256:2c143e57962bb1494a...
Pulling proxy2   ... status: image is up to date for a...
Pulling resolver ... done
Pulling proxy2   ... done
Pulling proxy1   ... digest: sha256:2c143e57962bb1494a...
Pulling proxy1   ... status: image is up to date for a...
Pulling proxy1   ... done
Pulling node     ... digest: sha256:2ea9da862c215fd684...
Pulling node     ... status: image is up to date for a...
Pulling node     ... done
Pulling minio1   ... error

ERROR: for minio1  pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied
pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied
 (cluster.py:2827, logging_pulling_images)
2026-09-30 17:14:29 [ 476 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/.env', '--project-name', 'roottestjoinsetfamilys3_gw2', '--file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check)
2026-09-30 17:15:22 [ 476 ] DEBUG : Stderr:Pulling proxy2   ...  (cluster.py:123, run_and_check)
2026-09-30 17:15:22 [ 476 ] DEBUG : Stderr:Pulling proxy1   ...  (cluster.py:123, run_and_check)
2026-09-30 17:15:22 [ 476 ] DEBUG : Stderr:Pulling minio1   ...  (cluster.py:123, run_and_check)
2026-09-30 17:15:22 [ 476 ] DEBUG : Stderr:Pulling node     ...  (cluster.py:123, run_and_check)
2026-09-30 17:15:22 [ 476 ] DEBUG : Stderr:Pulling resolver ...  (cluster.py:123, run_and_check)
2026-09-30 17:15:22 [ 476 ] DEBUG : Stderr:Pulling node     ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check)
2026-09-30 17:15:22 [ 476 ] DEBUG : Stderr:Pulling proxy2   ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check)
2026-09-30 17:15:22 [ 476 ] DEBUG : Stderr:Pulling proxy1   ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check)
2026-09-30 17:15:22 [ 476 ] DEBUG : Stderr:Pulling node     ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check)
2026-09-30 17:15:22 [ 476 ] DEBUG : Stderr:Pulling node     ... status: image is up to date for a... (cluster.py:123, run_and_check)
2026-09-30 17:15:22 [ 476 ] DEBUG : Stderr:Pulling proxy2   ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check)
2026-09-30 17:15:22 [ 476 ] DEBUG : Stderr:Pulling proxy2   ... status: image is up to date for a... (cluster.py:123, run_and_check)
2026-09-30 17:15:22 [ 476 ] DEBUG : Stderr:Pulling node     ... done (cluster.py:123, run_and_check)
2026-09-30 17:15:22 [ 476 ] DEBUG : Stderr:Pulling proxy2   ... done (cluster.py:123, run_and_check)
2026-09-30 17:15:22 [ 476 ] DEBUG : Stderr:Pulling proxy1   ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check)
2026-09-30 17:15:22 [ 476 ] DEBUG : Stderr:Pulling proxy1   ... status: image is up to date for a... (cluster.py:123, run_and_check)
2026-09-30 17:15:22 [ 476 ] DEBUG : Stderr:Pulling proxy1   ... done (cluster.py:123, run_and_check)
2026-09-30 17:15:22 [ 476 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check)
2026-09-30 17:15:22 [ 476 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check)
2026-09-30 17:15:22 [ 476 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check)
2026-09-30 17:15:22 [ 476 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check)
2026-09-30 17:15:22 [ 476 ] DEBUG : Stderr:Pulling minio1   ... error (cluster.py:123, run_and_check)
2026-09-30 17:15:22 [ 476 ] DEBUG : Stderr: (cluster.py:123, run_and_check)
2026-09-30 17:15:22 [ 476 ] DEBUG : Stderr:ERROR: for minio1  pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check)
2026-09-30 17:15:22 [ 476 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check)
2026-09-30 17:15:22 [ 476 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check)
2026-09-30 17:15:22 [ 476 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/.env', '--project-name', 'roottestjoinsetfamilys3_gw2', '--file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2   ... 
Pulling proxy1   ... 
Pulling minio1   ... 
Pulling node     ... 
Pulling resolver ... 
Pulling node     ... pulling from altinityinfra/integr...
Pulling proxy2   ... pulling from altinityinfra/s3-proxy
Pulling proxy1   ... pulling from altinityinfra/s3-proxy
Pulling node     ... digest: sha256:2ea9da862c215fd684...
Pulling node     ... status: image is up to date for a...
Pulling proxy2   ... digest: sha256:2c143e57962bb1494a...
Pulling proxy2   ... status: image is up to date for a...
Pulling node     ... done
Pulling proxy2   ... done
Pulling proxy1   ... digest: sha256:2c143e57962bb1494a...
Pulling proxy1   ... status: image is up to date for a...
Pulling proxy1   ... done
Pulling resolver ... pulling from altinityinfra/python...
Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d...
Pulling resolver ... status: image is up to date for a...
Pulling resolver ... done
Pulling minio1   ... error

ERROR: for minio1  pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied
pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied
 (cluster.py:2827, logging_pulling_images)
2026-09-30 17:15:25 [ 476 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/.env', '--project-name', 'roottestjoinsetfamilys3_gw2', '--file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check)
2026-09-30 17:16:17 [ 476 ] DEBUG : Stderr:Pulling proxy1   ...  (cluster.py:123, run_and_check)
2026-09-30 17:16:17 [ 476 ] DEBUG : Stderr:Pulling proxy2   ...  (cluster.py:123, run_and_check)
2026-09-30 17:16:17 [ 476 ] DEBUG : Stderr:Pulling minio1   ...  (cluster.py:123, run_and_check)
2026-09-30 17:16:17 [ 476 ] DEBUG : Stderr:Pulling node     ...  (cluster.py:123, run_and_check)
2026-09-30 17:16:17 [ 476 ] DEBUG : Stderr:Pulling resolver ...  (cluster.py:123, run_and_check)
2026-09-30 17:16:17 [ 476 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check)
2026-09-30 17:16:17 [ 476 ] DEBUG : Stderr:Pulling proxy2   ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check)
2026-09-30 17:16:17 [ 476 ] DEBUG : Stderr:Pulling proxy1   ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check)
2026-09-30 17:16:17 [ 476 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check)
2026-09-30 17:16:17 [ 476 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check)
2026-09-30 17:16:17 [ 476 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check)
2026-09-30 17:16:17 [ 476 ] DEBUG : Stderr:Pulling proxy2   ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check)
2026-09-30 17:16:17 [ 476 ] DEBUG : Stderr:Pulling proxy2   ... status: image is up to date for a... (cluster.py:123, run_and_check)
2026-09-30 17:16:17 [ 476 ] DEBUG : Stderr:Pulling proxy2   ... done (cluster.py:123, run_and_check)
2026-09-30 17:16:17 [ 476 ] DEBUG : Stderr:Pulling proxy1   ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check)
2026-09-30 17:16:17 [ 476 ] DEBUG : Stderr:Pulling proxy1   ... status: image is up to date for a... (cluster.py:123, run_and_check)
2026-09-30 17:16:17 [ 476 ] DEBUG : Stderr:Pulling proxy1   ... done (cluster.py:123, run_and_check)
2026-09-30 17:16:17 [ 476 ] DEBUG : Stderr:Pulling node     ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check)
2026-09-30 17:16:17 [ 476 ] DEBUG : Stderr:Pulling node     ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check)
2026-09-30 17:16:17 [ 476 ] DEBUG : Stderr:Pulling node     ... status: image is up to date for a... (cluster.py:123, run_and_check)
2026-09-30 17:16:17 [ 476 ] DEBUG : Stderr:Pulling node     ... done (cluster.py:123, run_and_check)
2026-09-30 17:16:17 [ 476 ] DEBUG : Stderr:Pulling minio1   ... error (cluster.py:123, run_and_check)
2026-09-30 17:16:17 [ 476 ] DEBUG : Stderr: (cluster.py:123, run_and_check)
2026-09-30 17:16:17 [ 476 ] DEBUG : Stderr:ERROR: for minio1  pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check)
2026-09-30 17:16:17 [ 476 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check)
2026-09-30 17:16:17 [ 476 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check)
2026-09-30 17:16:17 [ 476 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/.env', '--project-name', 'roottestjoinsetfamilys3_gw2', '--file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1   ... 
Pulling proxy2   ... 
Pulling minio1   ... 
Pulling node     ... 
Pulling resolver ... 
Pulling resolver ... pulling from altinityinfra/python...
Pulling proxy2   ... pulling from altinityinfra/s3-proxy
Pulling proxy1   ... pulling from altinityinfra/s3-proxy
Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d...
Pulling resolver ... status: image is up to date for a...
Pulling resolver ... done
Pulling proxy2   ... digest: sha256:2c143e57962bb1494a...
Pulling proxy2   ... status: image is up to date for a...
Pulling proxy2   ... done
Pulling proxy1   ... digest: sha256:2c143e57962bb1494a...
Pulling proxy1   ... status: image is up to date for a...
Pulling proxy1   ... done
Pulling node     ... pulling from altinityinfra/integr...
Pulling node     ... digest: sha256:2ea9da862c215fd684...
Pulling node     ... status: image is up to date for a...
Pulling node     ... done
Pulling minio1   ... error

ERROR: for minio1  pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied
pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied
 (cluster.py:2827, logging_pulling_images)
2026-09-30 17:16:21 [ 476 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/.env', '--project-name', 'roottestjoinsetfamilys3_gw2', '--file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check)
2026-09-30 17:17:15 [ 476 ] DEBUG : Stderr:Pulling proxy2   ...  (cluster.py:123, run_and_check)
2026-09-30 17:17:15 [ 476 ] DEBUG : Stderr:Pulling proxy1   ...  (cluster.py:123, run_and_check)
2026-09-30 17:17:15 [ 476 ] DEBUG : Stderr:Pulling minio1   ...  (cluster.py:123, run_and_check)
2026-09-30 17:17:15 [ 476 ] DEBUG : Stderr:Pulling node     ...  (cluster.py:123, run_and_check)
2026-09-30 17:17:15 [ 476 ] DEBUG : Stderr:Pulling resolver ...  (cluster.py:123, run_and_check)
2026-09-30 17:17:15 [ 476 ] DEBUG : Stderr:Pulling node     ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check)
2026-09-30 17:17:15 [ 476 ] DEBUG : Stderr:Pulling proxy2   ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check)
2026-09-30 17:17:15 [ 476 ] DEBUG : Stderr:Pulling node     ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check)
2026-09-30 17:17:15 [ 476 ] DEBUG : Stderr:Pulling node     ... status: image is up to date for a... (cluster.py:123, run_and_check)
2026-09-30 17:17:15 [ 476 ] DEBUG : Stderr:Pulling node     ... done (cluster.py:123, run_and_check)
2026-09-30 17:17:15 [ 476 ] DEBUG : Stderr:Pulling proxy2   ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check)
2026-09-30 17:17:15 [ 476 ] DEBUG : Stderr:Pulling proxy2   ... status: image is up to date for a... (cluster.py:123, run_and_check)
2026-09-30 17:17:15 [ 476 ] DEBUG : Stderr:Pulling proxy2   ... done (cluster.py:123, run_and_check)
2026-09-30 17:17:15 [ 476 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check)
2026-09-30 17:17:15 [ 476 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check)
2026-09-30 17:17:15 [ 476 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check)
2026-09-30 17:17:15 [ 476 ] DEBUG : Stderr:Pulling proxy1   ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check)
2026-09-30 17:17:15 [ 476 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check)
2026-09-30 17:17:15 [ 476 ] DEBUG : Stderr:Pulling proxy1   ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check)
2026-09-30 17:17:15 [ 476 ] DEBUG : Stderr:Pulling proxy1   ... status: image is up to date for a... (cluster.py:123, run_and_check)
2026-09-30 17:17:15 [ 476 ] DEBUG : Stderr:Pulling proxy1   ... done (cluster.py:123, run_and_check)
2026-09-30 17:17:15 [ 476 ] DEBUG : Stderr:Pulling minio1   ... error (cluster.py:123, run_and_check)
2026-09-30 17:17:15 [ 476 ] DEBUG : Stderr: (cluster.py:123, run_and_check)
2026-09-30 17:17:15 [ 476 ] DEBUG : Stderr:ERROR: for minio1  pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check)
2026-09-30 17:17:15 [ 476 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check)
2026-09-30 17:17:15 [ 476 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check)
2026-09-30 17:17:15 [ 476 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/.env', '--project-name', 'roottestjoinsetfamilys3_gw2', '--file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2   ... 
Pulling proxy1   ... 
Pulling minio1   ... 
Pulling node     ... 
Pulling resolver ... 
Pulling node     ... pulling from altinityinfra/integr...
Pulling proxy2   ... pulling from altinityinfra/s3-proxy
Pulling node     ... digest: sha256:2ea9da862c215fd684...
Pulling node     ... status: image is up to date for a...
Pulling node     ... done
Pulling proxy2   ... digest: sha256:2c143e57962bb1494a...
Pulling proxy2   ... status: image is up to date for a...
Pulling proxy2   ... done
Pulling resolver ... pulling from altinityinfra/python...
Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d...
Pulling resolver ... status: image is up to date for a...
Pulling proxy1   ... pulling from altinityinfra/s3-proxy
Pulling resolver ... done
Pulling proxy1   ... digest: sha256:2c143e57962bb1494a...
Pulling proxy1   ... status: image is up to date for a...
Pulling proxy1   ... done
Pulling minio1   ... error

ERROR: for minio1  pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied
pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied
 (cluster.py:2827, logging_pulling_images)
2026-09-30 17:17:20 [ 476 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/.env', '--project-name', 'roottestjoinsetfamilys3_gw2', '--file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check)
2026-09-30 17:18:23 [ 476 ] DEBUG : Stderr:Pulling proxy2   ...  (cluster.py:123, run_and_check)
2026-09-30 17:18:23 [ 476 ] DEBUG : Stderr:Pulling proxy1   ...  (cluster.py:123, run_and_check)
2026-09-30 17:18:23 [ 476 ] DEBUG : Stderr:Pulling resolver ...  (cluster.py:123, run_and_check)
2026-09-30 17:18:23 [ 476 ] DEBUG : Stderr:Pulling minio1   ...  (cluster.py:123, run_and_check)
2026-09-30 17:18:23 [ 476 ] DEBUG : Stderr:Pulling node     ...  (cluster.py:123, run_and_check)
2026-09-30 17:18:23 [ 476 ] DEBUG : Stderr:Pulling node     ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check)
2026-09-30 17:18:23 [ 476 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check)
2026-09-30 17:18:23 [ 476 ] DEBUG : Stderr:Pulling proxy1   ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check)
2026-09-30 17:18:23 [ 476 ] DEBUG : Stderr:Pulling proxy2   ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check)
2026-09-30 17:18:23 [ 476 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check)
2026-09-30 17:18:23 [ 476 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check)
2026-09-30 17:18:23 [ 476 ] DEBUG : Stderr:Pulling proxy1   ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check)
2026-09-30 17:18:23 [ 476 ] DEBUG : Stderr:Pulling proxy1   ... status: image is up to date for a... (cluster.py:123, run_and_check)
2026-09-30 17:18:23 [ 476 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check)
2026-09-30 17:18:23 [ 476 ] DEBUG : Stderr:Pulling proxy1   ... done (cluster.py:123, run_and_check)
2026-09-30 17:18:23 [ 476 ] DEBUG : Stderr:Pulling proxy2   ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check)
2026-09-30 17:18:23 [ 476 ] DEBUG : Stderr:Pulling proxy2   ... status: image is up to date for a... (cluster.py:123, run_and_check)
2026-09-30 17:18:23 [ 476 ] DEBUG : Stderr:Pulling node     ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check)
2026-09-30 17:18:23 [ 476 ] DEBUG : Stderr:Pulling node     ... status: image is up to date for a... (cluster.py:123, run_and_check)
2026-09-30 17:18:23 [ 476 ] DEBUG : Stderr:Pulling proxy2   ... done (cluster.py:123, run_and_check)
2026-09-30 17:18:23 [ 476 ] DEBUG : Stderr:Pulling node     ... done (cluster.py:123, run_and_check)
2026-09-30 17:18:23 [ 476 ] DEBUG : Stderr:Pulling minio1   ... error (cluster.py:123, run_and_check)
2026-09-30 17:18:23 [ 476 ] DEBUG : Stderr: (cluster.py:123, run_and_check)
2026-09-30 17:18:23 [ 476 ] DEBUG : Stderr:ERROR: for minio1  pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check)
2026-09-30 17:18:23 [ 476 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check)
2026-09-30 17:18:23 [ 476 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check)
2026-09-30 17:18:23 [ 476 ] DEBUG : Failed to start cluster:  (cluster.py:3178, start)
2026-09-30 17:18:23 [ 476 ] DEBUG : Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/.env', '--project-name', 'roottestjoinsetfamilys3_gw2', '--file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2   ... 
Pulling proxy1   ... 
Pulling resolver ... 
Pulling minio1   ... 
Pulling node     ... 
Pulling node     ... pulling from altinityinfra/integr...
Pulling resolver ... pulling from altinityinfra/python...
Pulling proxy1   ... pulling from altinityinfra/s3-proxy
Pulling proxy2   ... pulling from altinityinfra/s3-proxy
Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d...
Pulling resolver ... status: image is up to date for a...
Pulling proxy1   ... digest: sha256:2c143e57962bb1494a...
Pulling proxy1   ... status: image is up to date for a...
Pulling resolver ... done
Pulling proxy1   ... done
Pulling proxy2   ... digest: sha256:2c143e57962bb1494a...
Pulling proxy2   ... status: image is up to date for a...
Pulling node     ... digest: sha256:2ea9da862c215fd684...
Pulling node     ... status: image is up to date for a...
Pulling proxy2   ... done
Pulling node     ... done
Pulling minio1   ... error

ERROR: for minio1  pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied
pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied
 (cluster.py:3179, start)
2026-09-30 17:18:23 [ 476 ] DEBUG : None (cluster.py:3180, start)
2026-09-30 17:18:23 [ 476 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3246, shutdown)
2026-09-30 17:18:23 [ 476 ] DEBUG : Cleanup called (cluster.py:876, cleanup)
2026-09-30 17:18:23 [ 476 ] DEBUG : Docker networks for project roottestjoinsetfamilys3_gw2 are NETWORK ID   NAME      DRIVER    SCOPE
 (cluster.py:855, print_all_docker_pieces)
2026-09-30 17:18:23 [ 476 ] DEBUG : Docker containers for project roottestjoinsetfamilys3_gw2 are CONTAINER ID   IMAGE     COMMAND   CREATED   STATUS    PORTS     NAMES
 (cluster.py:863, print_all_docker_pieces)
2026-09-30 17:18:23 [ 476 ] DEBUG : Docker volumes for project roottestjoinsetfamilys3_gw2 are DRIVER    VOLUME NAME
 (cluster.py:871, print_all_docker_pieces)
2026-09-30 17:18:23 [ 476 ] DEBUG : Command:docker container list --all --filter name='^/roottestjoinsetfamilys3_gw2_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check)
2026-09-30 17:18:23 [ 476 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup)
2026-09-30 17:18:23 [ 476 ] DEBUG : No running containers for project: roottestjoinsetfamilys3_gw2 (cluster.py:904, cleanup)
2026-09-30 17:18:23 [ 476 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup)
2026-09-30 17:18:23 [ 476 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup)
2026-09-30 17:18:23 [ 476 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check)
2026-09-30 17:18:23 [ 476 ] DEBUG : Stdout:6 (cluster.py:121, run_and_check)
2026-09-30 17:18:23 [ 476 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3246, shutdown)
2026-09-30 17:18:23 [ 476 ] DEBUG : Cleanup called (cluster.py:876, cleanup)
2026-09-30 17:18:23 [ 476 ] DEBUG : Docker networks for project roottestjoinsetfamilys3_gw2 are NETWORK ID   NAME      DRIVER    SCOPE
 (cluster.py:855, print_all_docker_pieces)
2026-09-30 17:18:23 [ 476 ] DEBUG : Docker containers for project roottestjoinsetfamilys3_gw2 are CONTAINER ID   IMAGE     COMMAND   CREATED   STATUS    PORTS     NAMES
 (cluster.py:863, print_all_docker_pieces)
2026-09-30 17:18:23 [ 476 ] DEBUG : Docker volumes for project roottestjoinsetfamilys3_gw2 are DRIVER    VOLUME NAME
 (cluster.py:871, print_all_docker_pieces)
2026-09-30 17:18:23 [ 476 ] DEBUG : Command:docker container list --all --filter name='^/roottestjoinsetfamilys3_gw2_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check)
2026-09-30 17:18:23 [ 476 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup)
2026-09-30 17:18:23 [ 476 ] DEBUG : No running containers for project: roottestjoinsetfamilys3_gw2 (cluster.py:904, cleanup)
2026-09-30 17:18:23 [ 476 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup)
2026-09-30 17:18:23 [ 476 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup)
2026-09-30 17:18:23 [ 476 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check)
2026-09-30 17:18:23 [ 476 ] DEBUG : Stdout:6 (cluster.py:121, run_and_check)
________________________ ERROR at setup of test_set_s3 _________________________
[gw2] linux -- Python 3.10.12 /usr/bin/python3

    @pytest.fixture(scope="module")
    def cluster():
        try:
            cluster = ClickHouseCluster(__file__)
            cluster.add_instance(
                "node",
                main_configs=["configs/minio.xml", "configs/ssl.xml"],
                with_minio=True,
                stay_alive=True,
            )
            logging.info("Starting cluster...")
>           cluster.start()

test_join_set_family_s3/test.py:19: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
helpers/cluster.py:2831: in start
    retry(log_function=logging_pulling_images)(run_and_check)(
helpers/retry_decorator.py:28: in wrapper
    raise e
helpers/retry_decorator.py:19: in wrapper
    func(*args, **kwargs)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/.env', '--project-name', 'roottestjoinsetfamilys3_gw2', '--file', ...]
env = None, shell = False, stdout = -1, stderr = -1, timeout = 900
nothrow = False, detach = False

    def run_and_check(
        args,
        env=None,
        shell=False,
        stdout=subprocess.PIPE,
        stderr=subprocess.PIPE,
        timeout=300,
        nothrow=False,
        detach=False,
    ):
        if detach:
            subprocess.Popen(
                args,
                stdout=subprocess.DEVNULL,
                stderr=subprocess.DEVNULL,
                env=env,
                shell=shell,
            )
            return
    
        logging.debug(f"Command:{args}")
        res = subprocess.run(
            args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout
        )
        out = res.stdout.decode("utf-8", "ignore")
        err = res.stderr.decode("utf-8", "ignore")
        # check_call(...) from subprocess does not print stderr, so we do it manually
        for outline in out.splitlines():
            logging.debug(f"Stdout:{outline}")
        for errline in err.splitlines():
            logging.debug(f"Stderr:{errline}")
        if res.returncode != 0:
            logging.debug(f"Exitcode:{res.returncode}")
            if env:
                logging.debug(f"Env:{env}")
            if not nothrow:
>               raise Exception(
                    f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}"
                )
E               Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/.env', '--project-name', 'roottestjoinsetfamilys3_gw2', '--file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2   ... 
E               Pulling proxy1   ... 
E               Pulling resolver ... 
E               Pulling minio1   ... 
E               Pulling node     ... 
E               Pulling node     ... pulling from altinityinfra/integr...
E               Pulling resolver ... pulling from altinityinfra/python...
E               Pulling proxy1   ... pulling from altinityinfra/s3-proxy
E               Pulling proxy2   ... pulling from altinityinfra/s3-proxy
E               Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d...
E               Pulling resolver ... status: image is up to date for a...
E               Pulling proxy1   ... digest: sha256:2c143e57962bb1494a...
E               Pulling proxy1   ... status: image is up to date for a...
E               Pulling resolver ... done
E               Pulling proxy1   ... done
E               Pulling proxy2   ... digest: sha256:2c143e57962bb1494a...
E               Pulling proxy2   ... status: image is up to date for a...
E               Pulling node     ... digest: sha256:2ea9da862c215fd684...
E               Pulling node     ... status: image is up to date for a...
E               Pulling proxy2   ... done
E               Pulling node     ... done
E               Pulling minio1   ... error
E               
E               ERROR: for minio1  pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied
E               pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied

helpers/cluster.py:129: Exception
============================== slowest durations ===============================
309.69s setup    test_log_family_s3/test.py::test_log_family_s3[Log]
291.66s setup    test_join_set_family_s3/test.py::test_join_s3
273.00s call     test_kafka_bad_messages/test.py::test_bad_messages_parsing_stream
211.19s setup    test_kafka_bad_messages/test.py::test_bad_messages_parsing_exception
187.16s setup    test_mask_sensitive_info/test.py::test_backup_table
63.60s call     test_keeper_mntr_pressure/test.py::test_aggressive_mntr
61.53s setup    test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node0-True]
60.47s setup    test_modify_engine_on_restart/test_unusual_path.py::test_modify_engine_on_restart_with_unusual_path
60.38s setup    test_keeper_client/test.py::test_base_commands
59.04s setup    test_modify_engine_on_restart/test_zk_path_exists.py::test_modify_engine_fails_if_zk_path_exists
58.00s setup    test_keeper_back_to_back/test.py::test_concurrent_watches
56.51s setup    test_keeper_four_word_command/test.py::test_cmd_clrs
56.45s setup    test_filesystem_cache/test.py::test_caches_with_the_same_configuration[node]
56.06s setup    test_intersecting_parts/test.py::test_intersect_parts_when_restart
56.04s setup    test_keeper_mntr_pressure/test.py::test_aggressive_mntr
55.32s setup    test_merge_table_over_distributed/test.py::test_filtering
55.13s setup    test_multi_access_storage_role_management/test.py::test_quotas
54.92s setup    test_keeper_reconfig_replace_leader_in_one_command/test.py::test_reconfig_replace_leader_in_one_command
54.37s setup    test_keeper_four_word_command/test_allow_list.py::test_allow_list
54.11s setup    test_mutations_with_merge_tree/test.py::test_mutations_with_merge_background_task
54.09s setup    test_http_native/test.py::test_http_native_returns_timezone
53.74s setup    test_jbod_balancer/test.py::test_jbod_balanced_merge
49.75s setup    test_logs_level/test.py::test_check_client_logs_level
48.27s setup    test_file_schema_inference_cache/test.py::test
47.39s setup    test_keeper_session/test.py::test_session_close_shutdown
47.05s setup    test_grant_and_revoke/test_without_table_engine_grant.py::test_table_engine_and_source_grant
46.20s setup    test_keeper_nodes_move/test.py::test_node_move
46.17s setup    test_keeper_snapshot_on_exit/test.py::test_snapshot_on_exit
45.96s setup    test_fetch_partition_with_outdated_parts/test.py::test_fetch_partition_with_outdated_parts
44.80s call     test_keeper_nodes_move/test.py::test_node_move
43.92s setup    test_materialized_view_restart_server/test.py::test_materialized_view_with_subquery
42.54s setup    test_memory_limit_observer/test.py::test_memory_usage_doesnt_include_page_cache_size
40.17s setup    test_keeper_force_recovery_single_node/test.py::test_cluster_recovery
35.72s call     test_keeper_reconfig_replace_leader_in_one_command/test.py::test_reconfig_replace_leader_in_one_command
32.38s call     test_keeper_snapshot_on_exit/test.py::test_snapshot_on_exit
31.69s call     test_keeper_force_recovery_single_node/test.py::test_cluster_recovery
26.97s call     test_keeper_back_to_back/test.py::test_random_requests
26.80s call     test_keeper_back_to_back/test.py::test_concurrent_watches
22.47s call     test_mask_sensitive_info/test.py::test_table_functions
20.84s call     test_memory_limit_observer/test.py::test_memory_usage_doesnt_include_page_cache_size
20.23s call     test_jbod_balancer/test.py::test_replicated_balanced_merge_fetch
19.28s teardown test_kafka_bad_messages/test.py::test_bad_messages_to_mv
18.53s call     test_file_schema_inference_cache/test.py::test
15.71s call     test_kafka_bad_messages/test.py::test_bad_messages_to_mv
15.26s call     test_filesystem_cache/test.py::test_force_filesystem_cache_on_merges
14.56s call     test_filesystem_cache/test.py::test_custom_cached_disk
12.17s teardown test_fetch_partition_with_outdated_parts/test.py::test_fetch_partition_with_outdated_parts
12.16s call     test_keeper_back_to_back/test.py::test_watchers
11.97s call     test_filesystem_cache/test.py::test_parallel_cache_loading_on_startup[node]
11.70s call     test_keeper_session/test.py::test_session_close_shutdown
11.25s call     test_mask_sensitive_info/test.py::test_create_table
11.04s teardown test_keeper_reconfig_replace_leader_in_one_command/test.py::test_reconfig_replace_leader_in_one_command
10.19s call     test_memory_limit_observer/test.py::test_observe_memory_limit
8.26s call     test_modify_engine_on_restart/test_zk_path_exists.py::test_modify_engine_fails_if_zk_path_exists
7.80s call     test_mutations_with_merge_tree/test.py::test_mutations_with_merge_background_task
6.89s call     test_mutations_with_merge_tree/test.py::test_mutations_with_truncate_table
6.72s teardown test_merge_table_over_distributed/test.py::test_select_table_name_from_merge_over_distributed
6.22s teardown test_keeper_back_to_back/test.py::test_watchers
5.96s teardown test_intersecting_parts/test.py::test_intersect_parts_when_restart
5.80s call     test_multi_access_storage_role_management/test.py::test_role_from_different_storages
5.67s teardown test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[True]
5.57s teardown test_filesystem_cache/test.py::test_system_sync_filesystem_cache
5.50s call     test_kafka_bad_messages/test.py::test_bad_messages_parsing_exception
5.23s call     test_filesystem_cache/test.py::test_keep_up_size_ratio
5.03s call     test_modify_engine_on_restart/test_unusual_path.py::test_modify_engine_on_restart_with_unusual_path
4.69s teardown test_grant_and_revoke/test_without_table_engine_grant.py::test_table_engine_and_source_grant
4.51s teardown test_memory_limit_observer/test.py::test_observe_memory_limit
4.46s teardown test_http_native/test.py::test_http_native_returns_timezone
4.00s call     test_jbod_balancer/test.py::test_jbod_balanced_merge
3.95s teardown test_mask_sensitive_info/test.py::test_table_functions
3.62s call     test_failed_mutations/test.py::test_exponential_backoff_with_replicated_tree
3.52s teardown test_mutations_with_merge_tree/test.py::test_mutations_with_truncate_table
3.37s teardown test_modify_engine_on_restart/test_zk_path_exists.py::test_modify_engine_fails_if_zk_path_exists
3.36s teardown test_keeper_client/test.py::test_set_without_version
3.35s teardown test_modify_engine_on_restart/test_unusual_path.py::test_modify_engine_on_restart_with_unusual_path
3.28s teardown test_logs_level/test.py::test_check_client_logs_level
3.23s teardown test_keeper_mntr_pressure/test.py::test_aggressive_mntr
2.96s call     test_mask_sensitive_info/test.py::test_encryption_functions
2.94s teardown test_jbod_balancer/test.py::test_replicated_balanced_merge_fetch
2.79s teardown test_keeper_session/test.py::test_session_timeout
2.79s call     test_mask_sensitive_info/test.py::test_backup_to_s3
2.73s teardown test_keeper_four_word_command/test.py::test_cmd_ydld
2.72s teardown test_keeper_nodes_move/test.py::test_node_move
2.71s teardown test_file_schema_inference_cache/test.py::test
2.48s teardown test_keeper_force_recovery_single_node/test.py::test_cluster_recovery
2.48s teardown test_keeper_four_word_command/test_allow_list.py::test_allow_list
2.47s teardown test_keeper_snapshot_on_exit/test.py::test_snapshot_on_exit
2.40s call     test_multi_access_storage_role_management/test.py::test_quotas
2.35s call     test_mask_sensitive_info/test.py::test_table_function_ways_to_call
2.20s call     test_mask_sensitive_info/test.py::test_create_alter_user
2.14s teardown test_multi_access_storage_role_management/test.py::test_users
2.13s call     test_materialized_view_restart_server/test.py::test_materialized_view_with_subquery
2.13s call     test_multi_access_storage_role_management/test.py::test_settings_profiles
2.11s call     test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node0-True]
2.10s teardown test_materialized_view_restart_server/test.py::test_materialized_view_with_subquery
1.80s call     test_filesystem_cache/test.py::test_system_sync_filesystem_cache
1.79s call     test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[False]
1.75s call     test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[True]
1.71s call     test_multi_access_storage_role_management/test.py::test_roles
1.70s call     test_keeper_four_word_command/test_allow_list.py::test_allow_list
1.67s call     test_mask_sensitive_info/test.py::test_create_database
1.56s call     test_multi_access_storage_role_management/test.py::test_users
1.53s call     test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node1-False]
1.36s call     test_keeper_four_word_command/test.py::test_cmd_clrs
1.35s call     test_intersecting_parts/test.py::test_intersect_parts_when_restart
1.35s call     test_mask_sensitive_info/test.py::test_on_cluster
1.09s call     test_mask_sensitive_info/test.py::test_create_dictionary
1.04s call     test_keeper_four_word_command/test.py::test_cmd_rqld
1.03s call     test_keeper_four_word_command/test.py::test_cmd_ydld
0.89s call     test_fetch_partition_with_outdated_parts/test.py::test_fetch_partition_with_outdated_parts
0.85s call     test_grant_and_revoke/test_without_table_engine_grant.py::test_table_engine_and_source_grant
0.76s call     test_merge_table_over_distributed/test.py::test_filtering
0.66s call     test_keeper_four_word_command/test.py::test_cmd_mntr
0.64s call     test_keeper_four_word_command/test.py::test_cmd_lgif
0.62s call     test_keeper_back_to_back/test.py::test_stats
0.59s call     test_keeper_back_to_back/test.py::test_end_of_watches_session
0.57s call     test_filesystem_cache/test.py::test_caches_with_the_same_configuration[node]
0.50s call     test_filesystem_cache/test.py::test_caches_with_the_same_configuration_2[node_caches_with_same_path]
0.48s call     test_mask_sensitive_info/test.py::test_backup_table
0.36s call     test_merge_table_over_distributed/test.py::test_select_table_name_from_merge_over_distributed
0.33s call     test_keeper_four_word_command/test.py::test_cmd_stat
0.31s call     test_keeper_four_word_command/test.py::test_cmd_wchc
0.28s call     test_keeper_four_word_command/test.py::test_cmd_crst
0.27s call     test_keeper_four_word_command/test.py::test_cmd_dump
0.27s call     test_keeper_four_word_command/test.py::test_cmd_wchs
0.27s call     test_keeper_four_word_command/test.py::test_cmd_srvr
0.26s call     test_keeper_four_word_command/test.py::test_cmd_wchp
0.25s call     test_keeper_back_to_back/test.py::test_end_of_session
0.25s call     test_keeper_four_word_command/test.py::test_cmd_cons
0.24s call     test_keeper_back_to_back/test.py::test_sequential_nodes
0.18s call     test_merge_table_over_distributed/test.py::test_global_in
0.15s call     test_keeper_back_to_back/test.py::test_simple_commands
0.14s call     test_keeper_four_word_command/test.py::test_cmd_srst
0.13s call     test_keeper_back_to_back/test.py::test_multitransactions
0.13s call     test_keeper_four_word_command/test.py::test_cmd_conf
0.11s call     test_keeper_four_word_command/test.py::test_cmd_csnp
0.07s call     test_logs_level/test.py::test_check_client_logs_level
0.04s setup    test_keeper_client/test.py::test_set_with_version
0.04s teardown test_keeper_client/test.py::test_get_all_children_number
0.03s setup    test_keeper_client/test.py::test_delete_stale_backups
0.03s setup    test_keeper_client/test.py::test_rm_without_version
0.03s setup    test_keeper_client/test.py::test_rm_with_version
0.03s setup    test_keeper_client/test.py::test_four_letter_word_commands
0.03s setup    test_keeper_client/test.py::test_big_family
0.03s setup    test_keeper_client/test.py::test_quoted_argument_parsing
0.03s setup    test_keeper_client/test.py::test_get_all_children_number
0.03s setup    test_keeper_client/test.py::test_find_super_nodes
0.03s setup    test_keeper_client/test.py::test_set_without_version
0.03s call     test_keeper_client/test.py::test_get_all_children_number
0.03s call     test_keeper_session/test.py::test_session_timeout
0.02s call     test_keeper_client/test.py::test_find_super_nodes
0.02s call     test_keeper_client/test.py::test_delete_stale_backups
0.02s teardown test_keeper_back_to_back/test.py::test_random_requests
0.02s call     test_keeper_four_word_command/test.py::test_cmd_isro
0.02s call     test_keeper_client/test.py::test_big_family
0.02s teardown test_keeper_client/test.py::test_find_super_nodes
0.01s call     test_http_native/test.py::test_http_native_returns_timezone
0.01s call     test_keeper_four_word_command/test.py::test_cmd_ruok
0.01s call     test_keeper_client/test.py::test_set_with_version
0.01s teardown test_keeper_client/test.py::test_rm_with_version
0.01s teardown test_keeper_client/test.py::test_set_with_version
0.01s call     test_keeper_client/test.py::test_base_commands
0.01s teardown test_keeper_client/test.py::test_rm_without_version
0.01s teardown test_keeper_client/test.py::test_big_family
0.01s teardown test_keeper_client/test.py::test_four_letter_word_commands
0.01s teardown test_keeper_client/test.py::test_base_commands
0.01s call     test_keeper_client/test.py::test_rm_with_version
0.01s teardown test_keeper_client/test.py::test_quoted_argument_parsing
0.01s call     test_keeper_client/test.py::test_set_without_version
0.01s call     test_keeper_client/test.py::test_quoted_argument_parsing
0.01s teardown test_keeper_client/test.py::test_delete_stale_backups
0.01s teardown test_keeper_back_to_back/test.py::test_concurrent_watches
0.01s teardown test_kafka_bad_messages/test.py::test_bad_messages_parsing_stream
0.01s call     test_keeper_client/test.py::test_rm_without_version
0.00s teardown test_kafka_bad_messages/test.py::test_bad_messages_parsing_exception
0.00s teardown test_keeper_four_word_command/test.py::test_cmd_clrs
0.00s call     test_keeper_client/test.py::test_four_letter_word_commands
0.00s setup    test_filesystem_cache/test.py::test_parallel_cache_loading_on_startup[node]
0.00s teardown test_mask_sensitive_info/test.py::test_backup_table
0.00s teardown test_jbod_balancer/test.py::test_jbod_balanced_merge
0.00s setup    test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[False]
0.00s teardown test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node0-True]
0.00s setup    test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node1-False]
0.00s setup    test_mask_sensitive_info/test.py::test_backup_to_s3
0.00s setup    test_mask_sensitive_info/test.py::test_table_function_ways_to_call
0.00s teardown test_keeper_four_word_command/test.py::test_cmd_wchp
0.00s teardown test_keeper_back_to_back/test.py::test_end_of_watches_session
0.00s setup    test_filesystem_cache/test.py::test_system_sync_filesystem_cache
0.00s setup    test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[True]
0.00s teardown test_keeper_back_to_back/test.py::test_stats
0.00s setup    test_kafka_bad_messages/test.py::test_bad_messages_parsing_stream
0.00s teardown test_keeper_four_word_command/test.py::test_cmd_mntr
0.00s setup    test_keeper_four_word_command/test.py::test_cmd_wchs
0.00s setup    test_keeper_four_word_command/test.py::test_cmd_wchc
0.00s setup    test_keeper_four_word_command/test.py::test_cmd_csnp
0.00s setup    test_keeper_back_to_back/test.py::test_stats
0.00s setup    test_keeper_four_word_command/test.py::test_cmd_lgif
0.00s setup    test_keeper_back_to_back/test.py::test_random_requests
0.00s setup    test_keeper_back_to_back/test.py::test_watchers
0.00s setup    test_mask_sensitive_info/test.py::test_on_cluster
0.00s setup    test_mask_sensitive_info/test.py::test_table_functions
0.00s setup    test_keeper_four_word_command/test.py::test_cmd_rqld
0.00s setup    test_multi_access_storage_role_management/test.py::test_settings_profiles
0.00s setup    test_filesystem_cache/test.py::test_custom_cached_disk
0.00s setup    test_keeper_back_to_back/test.py::test_simple_commands
0.00s setup    test_keeper_back_to_back/test.py::test_end_of_watches_session
0.00s setup    test_merge_table_over_distributed/test.py::test_select_table_name_from_merge_over_distributed
0.00s setup    test_keeper_four_word_command/test.py::test_cmd_dump
0.00s setup    test_keeper_back_to_back/test.py::test_sequential_nodes
0.00s teardown test_keeper_four_word_command/test.py::test_cmd_lgif
0.00s teardown test_keeper_four_word_command/test.py::test_cmd_stat
0.00s setup    test_keeper_four_word_command/test.py::test_cmd_ruok
0.00s setup    test_keeper_four_word_command/test.py::test_cmd_isro
0.00s setup    test_multi_access_storage_role_management/test.py::test_role_from_different_storages
0.00s setup    test_kafka_bad_messages/test.py::test_bad_messages_to_mv
0.00s teardown test_keeper_four_word_command/test.py::test_cmd_dump
0.00s teardown test_mutations_with_merge_tree/test.py::test_mutations_with_merge_background_task
0.00s teardown test_keeper_back_to_back/test.py::test_multitransactions
0.00s teardown test_filesystem_cache/test.py::test_custom_cached_disk
0.00s setup    test_mask_sensitive_info/test.py::test_create_database
0.00s setup    test_filesystem_cache/test.py::test_force_filesystem_cache_on_merges
0.00s teardown test_mask_sensitive_info/test.py::test_encryption_functions
0.00s teardown test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[False]
0.00s setup    test_mask_sensitive_info/test.py::test_create_dictionary
0.00s teardown test_keeper_back_to_back/test.py::test_end_of_session
0.00s teardown test_keeper_four_word_command/test.py::test_cmd_crst
0.00s setup    test_failed_mutations/test.py::test_exponential_backoff_with_replicated_tree
0.00s setup    test_mask_sensitive_info/test.py::test_encryption_functions
0.00s teardown test_memory_limit_observer/test.py::test_memory_usage_doesnt_include_page_cache_size
0.00s setup    test_mask_sensitive_info/test.py::test_create_alter_user
0.00s teardown test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node1-False]
0.00s setup    test_filesystem_cache/test.py::test_keep_up_size_ratio
0.00s teardown test_keeper_four_word_command/test.py::test_cmd_rqld
0.00s teardown test_mask_sensitive_info/test.py::test_create_table
0.00s setup    test_keeper_four_word_command/test.py::test_cmd_crst
0.00s teardown test_join_set_family_s3/test.py::test_join_s3
0.00s setup    test_keeper_four_word_command/test.py::test_cmd_conf
0.00s teardown test_keeper_four_word_command/test.py::test_cmd_isro
0.00s setup    test_keeper_four_word_command/test.py::test_cmd_mntr
0.00s teardown test_mask_sensitive_info/test.py::test_table_function_ways_to_call
0.00s setup    test_keeper_four_word_command/test.py::test_cmd_wchp
0.00s teardown test_filesystem_cache/test.py::test_parallel_cache_loading_on_startup[node]
0.00s teardown test_keeper_back_to_back/test.py::test_sequential_nodes
0.00s teardown test_filesystem_cache/test.py::test_caches_with_the_same_configuration_2[node_caches_with_same_path]
0.00s setup    test_keeper_four_word_command/test.py::test_cmd_srvr
0.00s setup    test_memory_limit_observer/test.py::test_observe_memory_limit
0.00s setup    test_keeper_four_word_command/test.py::test_cmd_ydld
0.00s teardown test_keeper_four_word_command/test.py::test_cmd_srst
0.00s teardown test_mask_sensitive_info/test.py::test_on_cluster
0.00s setup    test_keeper_four_word_command/test.py::test_cmd_cons
0.00s setup    test_mutations_with_merge_tree/test.py::test_mutations_with_truncate_table
0.00s teardown test_filesystem_cache/test.py::test_keep_up_size_ratio
0.00s teardown test_multi_access_storage_role_management/test.py::test_quotas
0.00s teardown test_keeper_four_word_command/test.py::test_cmd_csnp
0.00s teardown test_keeper_four_word_command/test.py::test_cmd_conf
0.00s teardown test_multi_access_storage_role_management/test.py::test_roles
0.00s setup    test_multi_access_storage_role_management/test.py::test_roles
0.00s teardown test_failed_mutations/test.py::test_exponential_backoff_with_replicated_tree
0.00s teardown test_keeper_back_to_back/test.py::test_simple_commands
0.00s teardown test_mask_sensitive_info/test.py::test_create_database
0.00s teardown test_keeper_four_word_command/test.py::test_cmd_cons
0.00s teardown test_keeper_four_word_command/test.py::test_cmd_wchc
0.00s teardown test_mask_sensitive_info/test.py::test_backup_to_s3
0.00s teardown test_keeper_four_word_command/test.py::test_cmd_wchs
0.00s teardown test_filesystem_cache/test.py::test_caches_with_the_same_configuration[node]
0.00s teardown test_log_family_s3/test.py::test_log_family_s3[Log]
0.00s teardown test_filesystem_cache/test.py::test_force_filesystem_cache_on_merges
0.00s teardown test_merge_table_over_distributed/test.py::test_global_in
0.00s setup    test_join_set_family_s3/test.py::test_set_s3
0.00s teardown test_log_family_s3/test.py::test_stripe_log_truncate
0.00s teardown test_mask_sensitive_info/test.py::test_create_alter_user
0.00s setup    test_merge_table_over_distributed/test.py::test_global_in
0.00s teardown test_join_set_family_s3/test.py::test_set_s3
0.00s teardown test_log_family_s3/test.py::test_log_family_s3[StripeLog]
0.00s teardown test_multi_access_storage_role_management/test.py::test_role_from_different_storages
0.00s setup    test_keeper_back_to_back/test.py::test_multitransactions
0.00s setup    test_filesystem_cache/test.py::test_caches_with_the_same_configuration_2[node_caches_with_same_path]
0.00s setup    test_keeper_back_to_back/test.py::test_end_of_session
0.00s teardown test_keeper_session/test.py::test_session_close_shutdown
0.00s setup    test_jbod_balancer/test.py::test_replicated_balanced_merge_fetch
0.00s setup    test_multi_access_storage_role_management/test.py::test_users
0.00s teardown test_log_family_s3/test.py::test_log_family_s3[TinyLog]
0.00s setup    test_log_family_s3/test.py::test_log_family_s3[TinyLog]
0.00s setup    test_keeper_session/test.py::test_session_timeout
0.00s setup    test_log_family_s3/test.py::test_stripe_log_truncate
0.00s setup    test_keeper_four_word_command/test.py::test_cmd_srst
0.00s setup    test_mask_sensitive_info/test.py::test_create_table
0.00s teardown test_keeper_four_word_command/test.py::test_cmd_srvr
0.00s setup    test_log_family_s3/test.py::test_log_family_s3[StripeLog]
0.00s setup    test_keeper_four_word_command/test.py::test_cmd_stat
0.00s teardown test_keeper_four_word_command/test.py::test_cmd_ruok
0.00s teardown test_merge_table_over_distributed/test.py::test_filtering
0.00s teardown test_mask_sensitive_info/test.py::test_create_dictionary
0.00s teardown test_multi_access_storage_role_management/test.py::test_settings_profiles
=========================== short test summary info ============================
ERROR test_log_family_s3/test.py::test_log_family_s3[Log] - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw7/.env', '--project-name', 'roottestlogfamilys3_gw7', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw7/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2   ... 
ERROR test_log_family_s3/test.py::test_log_family_s3[StripeLog] - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw7/.env', '--project-name', 'roottestlogfamilys3_gw7', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw7/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2   ... 
ERROR test_log_family_s3/test.py::test_log_family_s3[TinyLog] - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw7/.env', '--project-name', 'roottestlogfamilys3_gw7', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw7/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2   ... 
ERROR test_log_family_s3/test.py::test_stripe_log_truncate - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw7/.env', '--project-name', 'roottestlogfamilys3_gw7', '--file', '/ClickHouse/tests/integration/test_log_family_s3/_instances_0_gw7/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2   ... 
ERROR test_join_set_family_s3/test.py::test_join_s3 - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/.env', '--project-name', 'roottestjoinsetfamilys3_gw2', '--file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2   ... 
ERROR test_join_set_family_s3/test.py::test_set_s3 - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/.env', '--project-name', 'roottestjoinsetfamilys3_gw2', '--file', '/ClickHouse/tests/integration/test_join_set_family_s3/_instances_0_gw2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2   ... 
PASSED test_merge_table_over_distributed/test.py::test_filtering
PASSED test_merge_table_over_distributed/test.py::test_global_in
PASSED test_merge_table_over_distributed/test.py::test_select_table_name_from_merge_over_distributed
PASSED test_filesystem_cache/test.py::test_caches_with_the_same_configuration[node]
PASSED test_filesystem_cache/test.py::test_caches_with_the_same_configuration_2[node_caches_with_same_path]
PASSED test_multi_access_storage_role_management/test.py::test_quotas
PASSED test_keeper_four_word_command/test.py::test_cmd_clrs
PASSED test_keeper_four_word_command/test.py::test_cmd_conf
PASSED test_keeper_four_word_command/test.py::test_cmd_cons
PASSED test_keeper_four_word_command/test.py::test_cmd_crst
PASSED test_keeper_four_word_command/test.py::test_cmd_csnp
PASSED test_keeper_four_word_command/test.py::test_cmd_dump
PASSED test_keeper_four_word_command/test.py::test_cmd_isro
PASSED test_keeper_four_word_command/test.py::test_cmd_lgif
PASSED test_keeper_four_word_command/test.py::test_cmd_mntr
PASSED test_keeper_client/test.py::test_base_commands
PASSED test_keeper_client/test.py::test_big_family
PASSED test_keeper_client/test.py::test_delete_stale_backups
PASSED test_keeper_client/test.py::test_find_super_nodes
PASSED test_keeper_client/test.py::test_four_letter_word_commands
PASSED test_keeper_client/test.py::test_get_all_children_number
PASSED test_keeper_client/test.py::test_quoted_argument_parsing
PASSED test_keeper_client/test.py::test_rm_with_version
PASSED test_keeper_client/test.py::test_rm_without_version
PASSED test_keeper_client/test.py::test_set_with_version
PASSED test_keeper_client/test.py::test_set_without_version
PASSED test_keeper_four_word_command/test.py::test_cmd_rqld
PASSED test_keeper_four_word_command/test.py::test_cmd_ruok
PASSED test_keeper_four_word_command/test.py::test_cmd_srst
PASSED test_keeper_four_word_command/test.py::test_cmd_srvr
PASSED test_keeper_four_word_command/test.py::test_cmd_stat
PASSED test_keeper_four_word_command/test.py::test_cmd_wchc
PASSED test_keeper_four_word_command/test.py::test_cmd_wchp
PASSED test_keeper_four_word_command/test.py::test_cmd_wchs
PASSED test_multi_access_storage_role_management/test.py::test_role_from_different_storages
PASSED test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node0-True]
PASSED test_keeper_four_word_command/test.py::test_cmd_ydld
PASSED test_multi_access_storage_role_management/test.py::test_roles
PASSED test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node1-False]
PASSED test_multi_access_storage_role_management/test.py::test_settings_profiles
PASSED test_multi_access_storage_role_management/test.py::test_users
PASSED test_failed_mutations/test.py::test_exponential_backoff_with_replicated_tree
PASSED test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[False]
PASSED test_filesystem_cache/test.py::test_custom_cached_disk
PASSED test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[True]
PASSED test_keeper_back_to_back/test.py::test_concurrent_watches
PASSED test_keeper_back_to_back/test.py::test_end_of_session
PASSED test_keeper_back_to_back/test.py::test_end_of_watches_session
PASSED test_keeper_back_to_back/test.py::test_multitransactions
PASSED test_filesystem_cache/test.py::test_force_filesystem_cache_on_merges
PASSED test_filesystem_cache/test.py::test_keep_up_size_ratio
PASSED test_filesystem_cache/test.py::test_parallel_cache_loading_on_startup[node]
PASSED test_filesystem_cache/test.py::test_system_sync_filesystem_cache
PASSED test_keeper_back_to_back/test.py::test_random_requests
PASSED test_keeper_back_to_back/test.py::test_sequential_nodes
PASSED test_keeper_back_to_back/test.py::test_simple_commands
PASSED test_keeper_back_to_back/test.py::test_stats
PASSED test_fetch_partition_with_outdated_parts/test.py::test_fetch_partition_with_outdated_parts
PASSED test_jbod_balancer/test.py::test_jbod_balanced_merge
PASSED test_keeper_session/test.py::test_session_close_shutdown
PASSED test_keeper_session/test.py::test_session_timeout
PASSED test_keeper_back_to_back/test.py::test_watchers
PASSED test_http_native/test.py::test_http_native_returns_timezone
PASSED test_jbod_balancer/test.py::test_replicated_balanced_merge_fetch
PASSED test_grant_and_revoke/test_without_table_engine_grant.py::test_table_engine_and_source_grant
PASSED test_mask_sensitive_info/test.py::test_backup_table
PASSED test_mask_sensitive_info/test.py::test_backup_to_s3
PASSED test_mask_sensitive_info/test.py::test_create_alter_user
PASSED test_intersecting_parts/test.py::test_intersect_parts_when_restart
PASSED test_mask_sensitive_info/test.py::test_create_database
PASSED test_file_schema_inference_cache/test.py::test
PASSED test_mask_sensitive_info/test.py::test_create_dictionary
PASSED test_mask_sensitive_info/test.py::test_create_table
PASSED test_memory_limit_observer/test.py::test_memory_usage_doesnt_include_page_cache_size
PASSED test_mask_sensitive_info/test.py::test_encryption_functions
PASSED test_keeper_snapshot_on_exit/test.py::test_snapshot_on_exit
PASSED test_mask_sensitive_info/test.py::test_on_cluster
PASSED test_mask_sensitive_info/test.py::test_table_function_ways_to_call
PASSED test_kafka_bad_messages/test.py::test_bad_messages_parsing_exception
PASSED test_memory_limit_observer/test.py::test_observe_memory_limit
PASSED test_keeper_mntr_pressure/test.py::test_aggressive_mntr
PASSED test_mask_sensitive_info/test.py::test_table_functions
PASSED test_materialized_view_restart_server/test.py::test_materialized_view_with_subquery
PASSED test_keeper_force_recovery_single_node/test.py::test_cluster_recovery
PASSED test_keeper_four_word_command/test_allow_list.py::test_allow_list
PASSED test_logs_level/test.py::test_check_client_logs_level
PASSED test_modify_engine_on_restart/test_unusual_path.py::test_modify_engine_on_restart_with_unusual_path
PASSED test_modify_engine_on_restart/test_zk_path_exists.py::test_modify_engine_fails_if_zk_path_exists
PASSED test_keeper_nodes_move/test.py::test_node_move
PASSED test_mutations_with_merge_tree/test.py::test_mutations_with_merge_background_task
PASSED test_keeper_reconfig_replace_leader_in_one_command/test.py::test_reconfig_replace_leader_in_one_command
PASSED test_mutations_with_merge_tree/test.py::test_mutations_with_truncate_table
PASSED test_kafka_bad_messages/test.py::test_bad_messages_parsing_stream
PASSED test_kafka_bad_messages/test.py::test_bad_messages_to_mv
=================== 94 passed, 6 errors in 526.41s (0:08:46) ===================
Traceback (most recent call last):
  File "/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration/./runner", line 445, in <module>
    subprocess.check_call(cmd, shell=True)
  File "/usr/lib/python3.10/subprocess.py", line 369, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command 'docker run   --rm --name clickhouse_integration_tests_v2s3tl --privileged --dns-search='.' --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=2cffe1eae894 -e DOCKER_BASE_TAG=b74d853ebe76 -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=caad4729259e   -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600  -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10  -rfEps --run-id=0 --color=no --durations=0 'test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node0-True]' 'test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node1-False]' test_failed_mutations/test.py::test_exponential_backoff_with_replicated_tree 'test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[False]' 'test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[True]' test_fetch_partition_with_outdated_parts/test.py::test_fetch_partition_with_outdated_parts test_file_schema_inference_cache/test.py::test 'test_filesystem_cache/test.py::test_caches_with_the_same_configuration[node]' 'test_filesystem_cache/test.py::test_caches_with_the_same_configuration_2[node_caches_with_same_path]' test_filesystem_cache/test.py::test_custom_cached_disk test_filesystem_cache/test.py::test_force_filesystem_cache_on_merges test_filesystem_cache/test.py::test_keep_up_size_ratio 'test_filesystem_cache/test.py::test_parallel_cache_loading_on_startup[node]' test_filesystem_cache/test.py::test_system_sync_filesystem_cache test_grant_and_revoke/test_without_table_engine_grant.py::test_table_engine_and_source_grant test_http_native/test.py::test_http_native_returns_timezone test_intersecting_parts/test.py::test_intersect_parts_when_restart test_jbod_balancer/test.py::test_jbod_balanced_merge test_jbod_balancer/test.py::test_replicated_balanced_merge_fetch test_join_set_family_s3/test.py::test_join_s3 test_join_set_family_s3/test.py::test_set_s3 test_kafka_bad_messages/test.py::test_bad_messages_parsing_exception test_kafka_bad_messages/test.py::test_bad_messages_parsing_stream test_kafka_bad_messages/test.py::test_bad_messages_to_mv test_keeper_back_to_back/test.py::test_concurrent_watches test_keeper_back_to_back/test.py::test_end_of_session test_keeper_back_to_back/test.py::test_end_of_watches_session test_keeper_back_to_back/test.py::test_multitransactions test_keeper_back_to_back/test.py::test_random_requests test_keeper_back_to_back/test.py::test_sequential_nodes test_keeper_back_to_back/test.py::test_simple_commands test_keeper_back_to_back/test.py::test_stats test_keeper_back_to_back/test.py::test_watchers test_keeper_client/test.py::test_base_commands test_keeper_client/test.py::test_big_family test_keeper_client/test.py::test_delete_stale_backups test_keeper_client/test.py::test_find_super_nodes test_keeper_client/test.py::test_four_letter_word_commands test_keeper_client/test.py::test_get_all_children_number test_keeper_client/test.py::test_quoted_argument_parsing test_keeper_client/test.py::test_rm_with_version test_keeper_client/test.py::test_rm_without_version test_keeper_client/test.py::test_set_with_version test_keeper_client/test.py::test_set_without_version test_keeper_force_recovery_single_node/test.py::test_cluster_recovery test_keeper_four_word_command/test.py::test_cmd_clrs test_keeper_four_word_command/test.py::test_cmd_conf test_keeper_four_word_command/test.py::test_cmd_cons test_keeper_four_word_command/test.py::test_cmd_crst test_keeper_four_word_command/test.py::test_cmd_csnp test_keeper_four_word_command/test.py::test_cmd_dump test_keeper_four_word_command/test.py::test_cmd_isro test_keeper_four_word_command/test.py::test_cmd_lgif test_keeper_four_word_command/test.py::test_cmd_mntr test_keeper_four_word_command/test.py::test_cmd_rqld test_keeper_four_word_command/test.py::test_cmd_ruok test_keeper_four_word_command/test.py::test_cmd_srst test_keeper_four_word_command/test.py::test_cmd_srvr test_keeper_four_word_command/test.py::test_cmd_stat test_keeper_four_word_command/test.py::test_cmd_wchc test_keeper_four_word_command/test.py::test_cmd_wchp test_keeper_four_word_command/test.py::test_cmd_wchs test_keeper_four_word_command/test.py::test_cmd_ydld test_keeper_four_word_command/test_allow_list.py::test_allow_list test_keeper_mntr_pressure/test.py::test_aggressive_mntr test_keeper_nodes_move/test.py::test_node_move test_keeper_reconfig_replace_leader_in_one_command/test.py::test_reconfig_replace_leader_in_one_command test_keeper_session/test.py::test_session_close_shutdown test_keeper_session/test.py::test_session_timeout test_keeper_snapshot_on_exit/test.py::test_snapshot_on_exit 'test_log_family_s3/test.py::test_log_family_s3[Log]' 'test_log_family_s3/test.py::test_log_family_s3[StripeLog]' 'test_log_family_s3/test.py::test_log_family_s3[TinyLog]' test_log_family_s3/test.py::test_stripe_log_truncate test_logs_level/test.py::test_check_client_logs_level test_mask_sensitive_info/test.py::test_backup_table test_mask_sensitive_info/test.py::test_backup_to_s3 test_mask_sensitive_info/test.py::test_create_alter_user test_mask_sensitive_info/test.py::test_create_database test_mask_sensitive_info/test.py::test_create_dictionary test_mask_sensitive_info/test.py::test_create_table test_mask_sensitive_info/test.py::test_encryption_functions test_mask_sensitive_info/test.py::test_on_cluster test_mask_sensitive_info/test.py::test_table_function_ways_to_call test_mask_sensitive_info/test.py::test_table_functions test_materialized_view_restart_server/test.py::test_materialized_view_with_subquery test_memory_limit_observer/test.py::test_memory_usage_doesnt_include_page_cache_size test_memory_limit_observer/test.py::test_observe_memory_limit test_merge_table_over_distributed/test.py::test_filtering test_merge_table_over_distributed/test.py::test_global_in test_merge_table_over_distributed/test.py::test_select_table_name_from_merge_over_distributed test_modify_engine_on_restart/test_unusual_path.py::test_modify_engine_on_restart_with_unusual_path test_modify_engine_on_restart/test_zk_path_exists.py::test_modify_engine_fails_if_zk_path_exists test_multi_access_storage_role_management/test.py::test_quotas test_multi_access_storage_role_management/test.py::test_role_from_different_storages test_multi_access_storage_role_management/test.py::test_roles test_multi_access_storage_role_management/test.py::test_settings_profiles test_multi_access_storage_role_management/test.py::test_users test_mutations_with_merge_tree/test.py::test_mutations_with_merge_background_task test_mutations_with_merge_tree/test.py::test_mutations_with_truncate_table  -vvv" altinityinfra/integration-tests-runner:cf95077f4609 ' returned non-zero exit status 1.